Sep 16 22:18:45 devstack cinder-volume[75239]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 22:18:45 devstack cinder-volume[75239]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 22:18:45 devstack cinder-volume[75239]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 22:18:47 devstack cinder-volume[75239]: INFO dbcounter [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Registered counter for database cinder Sep 16 22:18:47 devstack cinder-volume[75239]: DEBUG oslo_db.sqlalchemy.engines [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 22:18:47 devstack cinder-volume[75239]: DEBUG dbcounter [-] [75239] Writer thread running {{(pid=75239) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 22:18:47 devstack cinder-volume[75239]: INFO cinder.rpc [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 22:18:47 devstack cinder-volume[75239]: INFO cinder.rpc [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 22:18:47 devstack cinder-volume[75239]: DEBUG oslo_db.sqlalchemy.engines [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 22:18:47 devstack cinder-volume[75239]: INFO cinder.volume.manager [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Determined volume DB was empty at startup. Sep 16 22:18:47 devstack cinder-volume[75239]: DEBUG cinder.volume.manager [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75239) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 16 22:18:47 devstack cinder-volume[75239]: INFO cinder.volume.manager [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 22:18:47 devstack cinder-volume[75239]: WARNING stevedore.named [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 22:18:47 devstack cinder-volume[75239]: WARNING castellan.key_manager [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 22:18:47 devstack cinder-volume[75239]: WARNING cinder.keymgr.conf_key_mgr [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 22:18:47 devstack cinder-volume[75239]: DEBUG cinder.volume.drivers.lvm [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75239) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 16 22:18:47 devstack cinder-volume[75239]: DEBUG oslo_concurrency.processutils [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:18:48 devstack cinder-volume[75239]: DEBUG oslo_concurrency.processutils [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] CMD "cinder-rtstool verify" returned: 0 in 1.020s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_db.sqlalchemy.engines [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 22:18:49 devstack cinder-volume[75239]: INFO cinder.rpc [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 16 22:18:49 devstack cinder-volume[75239]: INFO cinder.rpc [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 16 22:18:49 devstack cinder-volume[75239]: WARNING stevedore.named [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 22:18:49 devstack cinder-volume[75239]: WARNING castellan.key_manager [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 22:18:49 devstack cinder-volume[75239]: INFO cinder.volume.manager [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_db.sqlalchemy.engines [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 22:18:49 devstack cinder-volume[75239]: INFO oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Starting 1 workers Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Started child 75385 {{(pid=75239) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Full set of CONF: {{(pid=75239) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] ******************************************************************************** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Configuration options gathered from: {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] ================================================================================ {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] allow_availability_zone_fallback = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] allow_compression_on_image_upload = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] allowed_direct_url_schemes = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] api_rate_limit = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] auth_strategy = keystone {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] az_cache_duration = 3600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_availability_zone = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_host = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_name = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_stats_polling_interval = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backup_api_class = cinder.backup.api.API {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backup_name_template = backup-%s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backup_use_same_host = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backup_use_temp_snapshot = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] chap_password = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] chap_username = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cinder_internal_tenant_project_id = 717789f1b97645f08a92dff2559bbcbd {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cinder_internal_tenant_user_id = 2abd804dbd7742f283186279ee88affe {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cloned_volume_same_az = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cluster = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] compression_format = gzip {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] compute_api_class = cinder.compute.nova.API {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] config_dir = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] config_source = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] control_exchange = openstack {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] debug = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] default_availability_zone = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] default_group_type = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] default_volume_type = lvmdriver-1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] driver_client_cert = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] driver_client_cert_key = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] driver_data_namespace = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] driver_ssl_cert_path = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] driver_ssl_cert_verify = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] driver_use_ssl = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] enable_force_upload = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] enable_new_services = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] enable_unsupported_driver = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] enforce_multipath_for_image_xfer = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] filter_function = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] glance_api_insecure = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] glance_api_ssl_compression = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] glance_ca_certificates_file = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] glance_catalog_info = image:glance:publicURL {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] glance_certfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] glance_keyfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] glance_num_retries = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] glance_request_timeout = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] goodness_function = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] graceful_shutdown_timeout = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75385]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] group_api_class = cinder.group.api.API {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] host = devstack {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] image_compress_on_upload = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] image_conversion_address_space_limit = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] image_conversion_cpu_limit = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] image_conversion_disable = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] image_upload_use_cinder_backend = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] image_upload_use_internal_tenant = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] image_volume_cache_enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] image_volume_cache_max_count = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] image_volume_cache_max_size_gb = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] init_host_max_objects_retrieval = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] instance_format = [instance: %(uuid)s] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] iscsi_iotype = fileio {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] iscsi_target_flags = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] iscsi_write_cache = on {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] iser_helper = tgtadm {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] iser_ip_address = 192.168.122.50 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] iser_port = 3260 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] log_color = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] log_config_append = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] log_dir = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] log_file = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] log_options = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] log_rotate_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] log_rotate_interval_type = days {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] log_rotation_type = none {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] max_age = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] max_logfile_count = 30 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] max_logfile_size_mb = 200 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] max_over_subscription_ratio = 20.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] message_reap_interval = 86400 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] message_ttl = 2592000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] migration_create_volume_timeout_secs = 300 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] monkey_patch = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] monkey_patch_modules = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] my_ip = 192.168.122.50 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] no_snapshot_gb_quota = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] num_iser_scan_tries = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] num_shell_tries = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] num_volume_device_scan_tries = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] nvmeof_conn_info_version = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] nvmet_ns_id = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] nvmet_port_id = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] osapi_max_limit = 1000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] osapi_volume_ext_list = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] osapi_volume_listen_port = 8776 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] osapi_volume_use_ssl = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] osapi_volume_workers = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] per_volume_size_limit = -1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] periodic_fuzzy_delay = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] periodic_interval = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] public_endpoint = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] publish_errors = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] quota_backup_gigabytes = 1000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] quota_backups = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] quota_gigabytes = 1000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] quota_groups = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] quota_snapshots = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] quota_volumes = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] rate_limit_burst = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] rate_limit_except_level = CRITICAL {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] rate_limit_interval = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] reinit_driver_count = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] replication_device = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] report_discard_supported = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] report_interval = 120 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] reservation_clean_interval = 86400 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] reservation_expire = 86400 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] reserved_image_namespaces = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] reserved_percentage = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] rpc_response_timeout = 120 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] run_external_periodic_tasks = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] scst_target_driver = iscsi {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] scst_target_iqn_name = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_down_time = 720 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] shell_completion = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] snapshot_name_template = snapshot-%s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] snapshot_same_host = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] split_loggers = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] state_path = /opt/stack/data/cinder {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] storage_availability_zone = nova {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] storage_protocol = iSCSI {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] syslog_log_facility = LOG_USER {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] target_helper = lioadm {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] target_ip_address = 192.168.122.50 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] target_port = 3260 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] target_protocol = iscsi {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] target_secondary_ip_addresses = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] trace_flags = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] transport_url = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] until_refresh = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] use_chap_auth = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] use_default_quota_class = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] use_journal = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] use_json = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] use_multipath_for_image_xfer = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] use_stderr = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] use_syslog = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] verify_glance_signatures = enabled {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_api_class = cinder.volume.api.API {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_backend_name = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_clear = zero {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_clear_ionice = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_clear_size = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_copy_bps_limit = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_dd_blocksize = 1M {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_name_template = volume-%s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_service_inithost_offload = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volume_usage_audit_period = month {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] watch_log_file = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] zoning_mode = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_concurrency.disable_process_locking = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.admin_password = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.admin_token = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.admin_user = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.auth_port = 35357 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.auth_protocol = https {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.auth_section = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.auth_type = password {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.auth_uri = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.auth_version = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.cache = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.certfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.identity_uri = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.include_service_catalog = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.insecure = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.interface = public {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.keyfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_password = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcache_username = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.region_name = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.service_type = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.backend = dogpile.cache.null {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.backend_argument = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.backend_expiration_time = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.config_prefix = cache.oslo {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.dead_timeout = 60.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.debug_cache_backend = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.enable_retry_client = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.enable_socket_keepalive = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.enforce_fips_mode = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.expiration_time = 600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.hashclient_retry_attempts = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.hashclient_retry_delay = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.memcache_dead_retry = 300 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.memcache_password = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.memcache_pool_maxsize = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.memcache_sasl_enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.memcache_socket_timeout = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.memcache_username = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.proxies = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.redis_db = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.redis_password = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.redis_server = localhost:6379 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.redis_socket_timeout = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.redis_username = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.retry_attempts = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.retry_delay = 0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.socket_keepalive_count = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.socket_keepalive_idle = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.socket_keepalive_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.tls_allowed_ciphers = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.tls_cafile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.tls_certfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.tls_enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cache.tls_keyfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] coordination.backend_url = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.asyncio_connection = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.asyncio_slave_connection = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.backend = sqlalchemy {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.connection = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.connection_debug = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.connection_parameters = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.connection_recycle_time = 3600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.connection_trace = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.db_inc_retry_interval = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.db_max_retries = 20 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.db_max_retry_interval = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.db_retry_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.max_overflow = 50 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.max_pool_size = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.max_retries = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.mysql_wsrep_sync_wait = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.pool_timeout = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.retry_interval = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.slave_connection = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.sqlite_synchronous = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] database.use_db_reconnect = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.connection_string = messaging:// {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.es_doc_type = notification {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.es_scroll_size = 10000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.es_scroll_time = 2m {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.filter_error_trace = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.hmac_keys = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.sentinel_service_name = mymaster {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.socket_timeout = 0.1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.trace_requests = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler.trace_sqlalchemy = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler_jaeger.process_tags = {} {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler_jaeger.service_name_prefix = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] profiler_otlp.service_name_prefix = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.enforce_new_defaults = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: WARNING oslo_config.cfg [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.enforce_scope = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.policy_default_rule = default {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.policy_file = policy.yaml {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] privsep_osbrick.group = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] privsep_osbrick.helper_command = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] privsep_osbrick.user = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cinder_sys_admin.group = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cinder_sys_admin.helper_command = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] cinder_sys_admin.user = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_user.auth_section = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_user.auth_type = password {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_user.certfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_user.collect_timing = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_user.insecure = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_user.keyfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_user.send_service_user_token = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_user.split_loggers = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] service_user.timeout = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.backend_availability_zone = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.backend_host = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.chap_password = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.chap_username = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.driver_client_cert = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.driver_client_cert_key = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.driver_data_namespace = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.driver_use_ssl = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.extra_capabilities = {} {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.filter_function = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.goodness_function = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.iscsi_iotype = fileio {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.iscsi_target_flags = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.iscsi_write_cache = on {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.iser_helper = tgtadm {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.iser_port = 3260 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.lvm_share_target = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.lvm_type = auto {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.num_shell_tries = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.replication_device = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.report_discard_supported = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.reserved_percentage = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.target_helper = tgtadm {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.target_port = 3260 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.target_protocol = iscsi {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.trace_flags = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.unique_fqdn_network = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.use_chap_auth = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.volume_backend_name = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.volume_clear = zero {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.volume_clear_ionice = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.volume_clear_size = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_reports.file_event_handler = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_reports.log_dir = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.backend_host = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.chap_password = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.chap_username = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.driver_client_cert = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:49 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.extra_capabilities = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.filter_function = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.goodness_function = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.iscsi_iotype = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.iser_helper = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.iser_ip_address = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.iser_port = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.lvm_share_target = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.lvm_type = auto {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.num_shell_tries = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.replication_device = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.report_discard_supported = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.reserved_percentage = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.scst_target_driver = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.storage_protocol = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.target_helper = lioadm {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.target_ip_address = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.target_port = 3260 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.trace_flags = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.use_chap_auth = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.volume_clear = zero {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.volume_clear_size = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] lvmdriver-1.volumes_dir = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.ssl = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_notifications.driver = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75385]: INFO cinder.volume.manager [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_notifications.retry = -1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] key_manager.fixed_key = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.barbican_api_version = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.barbican_endpoint = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.barbican_endpoint_type = public {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.barbican_region_name = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.cafile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.certfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.collect_timing = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.insecure = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.keyfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.number_of_retries = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.retry_delay = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.send_service_user_token = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.split_loggers = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.timeout = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.verify_ssl = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican.verify_ssl_path = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican_service_user.auth_section = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican_service_user.auth_type = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican_service_user.cafile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican_service_user.certfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican_service_user.collect_timing = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican_service_user.insecure = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican_service_user.keyfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican_service_user.split_loggers = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] barbican_service_user.timeout = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.approle_role_id = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.approle_secret_id = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.kv_mountpoint = secret {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.kv_path = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.kv_version = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.namespace = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.root_token_id = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.ssl_ca_crt_file = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.timeout = 60.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.use_ssl = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:18:50 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] ******************************************************************************** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 16 22:18:50 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.109s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:18:50 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:18:50 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:18:50 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:18:50 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:18:50 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:18:50 devstack sudo[75438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 16 22:18:50 devstack sudo[75438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:18:52 devstack sudo[75438]: pam_unix(sudo:session): session closed for user root Sep 16 22:18:52 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 1.966s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:18:52 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:18:52 devstack sudo[75556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:18:52 devstack sudo[75556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:18:54 devstack sudo[75556]: pam_unix(sudo:session): session closed for user root Sep 16 22:18:54 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.954s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:18:54 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:18:54 devstack cinder-volume[75385]: INFO cinder.brick.local_dev.lvm [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 16 22:18:54 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:18:54 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.076s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:18:54 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:18:54 devstack sudo[75651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:18:54 devstack sudo[75651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:18:56 devstack sudo[75651]: pam_unix(sudo:session): session closed for user root Sep 16 22:18:56 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.960s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:18:56 devstack cinder-volume[75385]: DEBUG cinder.brick.local_dev.lvm [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75385) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 16 22:18:56 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:18:56 devstack sudo[75744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:18:56 devstack sudo[75744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:18:59 devstack cinder-volume[75239]: DEBUG dbcounter [-] [75239] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75239) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:19:00 devstack sudo[75744]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:00 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.843s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:00 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:00 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.148s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:00 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:00 devstack sudo[75937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:19:00 devstack sudo[75937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:02 devstack sudo[75937]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:02 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.247s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:02 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:02 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.099s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:02 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:03 devstack sudo[75974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 16 22:19:03 devstack sudo[75974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:05 devstack sudo[75974]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:05 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.854s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:05 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:06 devstack sudo[76073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:19:06 devstack sudo[76073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:08 devstack sudo[76073]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:08 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.378s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:08 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:08 devstack sudo[76097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:19:08 devstack sudo[76097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:10 devstack sudo[76097]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:10 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.666s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:10 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:11 devstack sudo[76103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:19:11 devstack sudo[76103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:13 devstack sudo[76103]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:13 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.470s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:13 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:13 devstack sudo[76108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:19:13 devstack sudo[76108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:15 devstack sudo[76108]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:15 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.224s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:15 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:15 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.094s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:15 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:15 devstack sudo[76138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:19:15 devstack sudo[76138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:17 devstack sudo[76138]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:17 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.866s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:17 devstack cinder-volume[75385]: INFO cinder.volume.drivers.lvm [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 16 22:19:17 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:17 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.079s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:17 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:17 devstack sudo[76231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:19:17 devstack sudo[76231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:19 devstack sudo[76231]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:19 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.932s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:19 devstack cinder-volume[75385]: DEBUG cinder.volume.drivers.lvm [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Updating volume stats {{(pid=75385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 22:19:19 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:19 devstack sudo[76366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:19:19 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:21 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:21 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.957s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:21 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:21 devstack sudo[76375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:19:21 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:23 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:23 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.878s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:23 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:23 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:19:23 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:25 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:25 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.953s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:25 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:25 devstack sudo[76386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:19:25 devstack sudo[76386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:27 devstack sudo[76386]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:27 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.842s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:27 devstack cinder-volume[75385]: INFO cinder.volume.driver [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 22:19:27 devstack cinder-volume[75385]: DEBUG cinder.volume.driver [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75385) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 16 22:19:27 devstack cinder-volume[75385]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 22:19:27 devstack cinder-volume[75385]: DEBUG dbcounter [-] [75385] Writer thread running {{(pid=75385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 22:19:27 devstack cinder-volume[75385]: DEBUG cinder.db.sqlalchemy.api [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Building query based on filter {{(pid=75385) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 16 22:19:27 devstack cinder-volume[75385]: DEBUG cinder.image.image_utils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75385) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 16 22:19:27 devstack cinder-volume[75385]: INFO cinder.keymgr.migration [None req-1ca49ff3-884d-42ab-9c02-f029845b0afd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 22:19:27 devstack cinder-volume[75385]: DEBUG cinder.volume.drivers.lvm [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Updating volume stats {{(pid=75385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 22:19:27 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:28 devstack sudo[76419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:19:28 devstack sudo[76419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:29 devstack sudo[76419]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:29 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.913s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:29 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:30 devstack sudo[76529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:19:30 devstack sudo[76529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:31 devstack sudo[76529]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:31 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.919s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:31 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:31 devstack sudo[76538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:19:31 devstack sudo[76538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:33 devstack sudo[76538]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:33 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.899s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:33 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:33 devstack sudo[76541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:19:33 devstack sudo[76541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:35 devstack sudo[76541]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:35 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.706s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:35 devstack cinder-volume[75385]: DEBUG cinder.manager [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Notifying Schedulers of capabilities ... {{(pid=75385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:19:35 devstack cinder-volume[75385]: INFO cinder.volume.manager [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Driver initialization completed successfully. Sep 16 22:19:35 devstack cinder-volume[75385]: INFO cinder.manager [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Initiating service 2 cleanup Sep 16 22:19:35 devstack cinder-volume[75385]: INFO cinder.manager [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Service 2 cleanup completed. Sep 16 22:19:35 devstack cinder-volume[75385]: DEBUG cinder.service [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Creating RPC server for service cinder-volume {{(pid=75385) start /opt/stack/cinder/cinder/service.py:239}} Sep 16 22:19:35 devstack cinder-volume[75385]: DEBUG cinder.service [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75385) start /opt/stack/cinder/cinder/service.py:245}} Sep 16 22:19:35 devstack cinder-volume[75385]: INFO cinder.volume.manager [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 16 22:19:35 devstack cinder-volume[75385]: DEBUG cinder.volume.drivers.lvm [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Updating volume stats {{(pid=75385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 22:19:35 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:36 devstack sudo[76549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:19:36 devstack sudo[76549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:38 devstack sudo[76549]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:38 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.060s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:38 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:38 devstack sudo[76558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:19:38 devstack sudo[76558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:39 devstack sudo[76558]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:39 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.913s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:40 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:40 devstack sudo[76566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:19:40 devstack sudo[76566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:42 devstack sudo[76566]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:42 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.030s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:42 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:19:42 devstack sudo[76570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:19:42 devstack sudo[76570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:19:43 devstack sudo[76570]: pam_unix(sudo:session): session closed for user root Sep 16 22:19:43 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.882s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:19:44 devstack cinder-volume[75385]: INFO cinder.volume.manager [None req-d2b65fce-6b83-4f5c-a28b-d623fe1b4e83 None None] Driver post RPC initialization completed successfully. Sep 16 22:19:54 devstack cinder-volume[75385]: DEBUG dbcounter [-] [75385] Writing DB stats cinder:SELECT=3 {{(pid=75385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:19:54 devstack cinder-volume[75385]: DEBUG dbcounter [-] [75385] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:20:24 devstack cinder-volume[75385]: DEBUG oslo_service.periodic_task [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75385) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:20:24 devstack cinder-volume[75385]: DEBUG cinder.volume.drivers.lvm [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Updating volume stats {{(pid=75385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 22:20:24 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:20:24 devstack sudo[77544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:20:24 devstack sudo[77544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:20:26 devstack sudo[77544]: pam_unix(sudo:session): session closed for user root Sep 16 22:20:26 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.525s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:20:26 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:20:26 devstack sudo[77551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:20:26 devstack sudo[77551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:20:28 devstack sudo[77551]: pam_unix(sudo:session): session closed for user root Sep 16 22:20:28 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.016s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:20:28 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:20:28 devstack sudo[77557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:20:28 devstack sudo[77557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:20:30 devstack sudo[77557]: pam_unix(sudo:session): session closed for user root Sep 16 22:20:30 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.982s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:20:30 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:20:30 devstack sudo[77568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:20:30 devstack sudo[77568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:20:32 devstack sudo[77568]: pam_unix(sudo:session): session closed for user root Sep 16 22:20:32 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.949s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:20:32 devstack cinder-volume[75385]: DEBUG cinder.manager [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Notifying Schedulers of capabilities ... {{(pid=75385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:21:24 devstack cinder-volume[75385]: DEBUG oslo_service.periodic_task [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75385) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:21:24 devstack cinder-volume[75385]: DEBUG cinder.volume.drivers.lvm [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Updating volume stats {{(pid=75385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 22:21:24 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:21:24 devstack sudo[78311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:21:24 devstack sudo[78311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:21:26 devstack sudo[78311]: pam_unix(sudo:session): session closed for user root Sep 16 22:21:26 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.921s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:21:26 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:21:26 devstack sudo[78334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:21:26 devstack sudo[78334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:21:28 devstack sudo[78334]: pam_unix(sudo:session): session closed for user root Sep 16 22:21:28 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.922s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:21:28 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:21:28 devstack sudo[78337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:21:28 devstack sudo[78337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:21:30 devstack sudo[78337]: pam_unix(sudo:session): session closed for user root Sep 16 22:21:30 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.924s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:21:30 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:21:30 devstack sudo[78341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:21:30 devstack sudo[78341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:21:31 devstack sudo[78341]: pam_unix(sudo:session): session closed for user root Sep 16 22:21:32 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.965s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:21:32 devstack cinder-volume[75385]: DEBUG cinder.manager [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Notifying Schedulers of capabilities ... {{(pid=75385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:21:54 devstack cinder-volume[75385]: DEBUG dbcounter [-] [75385] Writing DB stats cinder:SELECT=1 {{(pid=75385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:21:54 devstack cinder-volume[75385]: DEBUG dbcounter [-] [75385] Writing DB stats cinder:UPDATE=1 {{(pid=75385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:22:24 devstack cinder-volume[75385]: DEBUG oslo_service.periodic_task [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75385) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:22:24 devstack cinder-volume[75385]: DEBUG cinder.volume.drivers.lvm [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Updating volume stats {{(pid=75385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 22:22:24 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:22:24 devstack sudo[80646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:22:24 devstack sudo[80646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:22:26 devstack sudo[80646]: pam_unix(sudo:session): session closed for user root Sep 16 22:22:26 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.005s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:22:26 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:22:26 devstack sudo[80796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:22:26 devstack sudo[80796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:22:28 devstack sudo[80796]: pam_unix(sudo:session): session closed for user root Sep 16 22:22:28 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.947s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:22:28 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:22:28 devstack sudo[80948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:22:28 devstack sudo[80948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:22:30 devstack sudo[80948]: pam_unix(sudo:session): session closed for user root Sep 16 22:22:30 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.923s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:22:30 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:22:30 devstack sudo[81091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:22:30 devstack sudo[81091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:22:32 devstack sudo[81091]: pam_unix(sudo:session): session closed for user root Sep 16 22:22:32 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.909s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:22:32 devstack cinder-volume[75385]: DEBUG cinder.manager [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Notifying Schedulers of capabilities ... {{(pid=75385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:23:24 devstack cinder-volume[75385]: DEBUG oslo_service.periodic_task [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75385) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:23:24 devstack cinder-volume[75385]: DEBUG cinder.volume.drivers.lvm [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Updating volume stats {{(pid=75385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 22:23:24 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:23:24 devstack sudo[81623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:23:24 devstack sudo[81623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:23:26 devstack sudo[81623]: pam_unix(sudo:session): session closed for user root Sep 16 22:23:26 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.838s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:23:26 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:23:26 devstack sudo[81630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:23:26 devstack sudo[81630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:23:27 devstack sudo[81630]: pam_unix(sudo:session): session closed for user root Sep 16 22:23:27 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.894s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:23:27 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:23:28 devstack sudo[81639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:23:28 devstack sudo[81639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:23:29 devstack sudo[81639]: pam_unix(sudo:session): session closed for user root Sep 16 22:23:29 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.764s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:23:29 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:23:29 devstack sudo[81651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:23:29 devstack sudo[81651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:23:31 devstack sudo[81651]: pam_unix(sudo:session): session closed for user root Sep 16 22:23:31 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.888s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:23:31 devstack cinder-volume[75385]: DEBUG cinder.manager [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Notifying Schedulers of capabilities ... {{(pid=75385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:23:54 devstack cinder-volume[75385]: DEBUG dbcounter [-] [75385] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:24:24 devstack cinder-volume[75385]: DEBUG oslo_service.periodic_task [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75385) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:24:24 devstack cinder-volume[75385]: DEBUG cinder.volume.drivers.lvm [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Updating volume stats {{(pid=75385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 22:24:24 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:24:24 devstack sudo[81855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 22:24:24 devstack sudo[81855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:24:25 devstack sudo[81855]: pam_unix(sudo:session): session closed for user root Sep 16 22:24:25 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.749s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:24:25 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:24:26 devstack sudo[81864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:24:26 devstack sudo[81864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:24:27 devstack sudo[81864]: pam_unix(sudo:session): session closed for user root Sep 16 22:24:27 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.666s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:24:27 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:24:27 devstack sudo[81870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 22:24:27 devstack sudo[81870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:24:29 devstack sudo[81870]: pam_unix(sudo:session): session closed for user root Sep 16 22:24:29 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.701s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:24:29 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:24:29 devstack sudo[81875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 22:24:29 devstack sudo[81875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:24:31 devstack sudo[81875]: pam_unix(sudo:session): session closed for user root Sep 16 22:24:31 devstack cinder-volume[75385]: DEBUG oslo_concurrency.processutils [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.965s {{(pid=75385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:24:31 devstack cinder-volume[75385]: DEBUG cinder.manager [None req-4684ee2a-99aa-430a-9d30-d3d614d8850e None None] Notifying Schedulers of capabilities ... {{(pid=75385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:25:02 devstack cinder-volume[75239]: INFO oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Caught SIGTERM, stopping children Sep 16 22:25:02 devstack cinder-volume[75239]: DEBUG oslo_concurrency.lockutils [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Acquiring lock "singleton_lock" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 22:25:02 devstack cinder-volume[75239]: DEBUG oslo_concurrency.lockutils [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Acquired lock "singleton_lock" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 22:25:02 devstack cinder-volume[75239]: DEBUG oslo_concurrency.lockutils [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Releasing lock "singleton_lock" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 22:25:02 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Stop services. {{(pid=75239) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 16 22:25:02 devstack cinder-volume[75239]: DEBUG oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Killing children. {{(pid=75239) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 16 22:25:02 devstack cinder-volume[75239]: INFO oslo_service.backend._eventlet.service [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Waiting on 1 children to exit Sep 16 22:25:07 devstack cinder-volume[75385]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 16 22:25:11 devstack cinder-volume[75385]: DEBUG oslo_concurrency.lockutils [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Acquiring lock "singleton_lock" {{(pid=75385) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 22:25:11 devstack cinder-volume[75385]: DEBUG oslo_concurrency.lockutils [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Acquired lock "singleton_lock" {{(pid=75385) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 22:25:11 devstack cinder-volume[75385]: DEBUG oslo_concurrency.lockutils [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Releasing lock "singleton_lock" {{(pid=75385) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 22:25:11 devstack cinder-volume[75385]: WARNING amqp [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 22:25:11 devstack cinder-volume[75385]: WARNING amqp [None req-a5013d22-fc66-438b-b47b-07c785ef0f76 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 22:25:23 devstack cinder-volume[82899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 22:25:23 devstack cinder-volume[82899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 22:25:23 devstack cinder-volume[82899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 22:25:26 devstack cinder-volume[82899]: INFO dbcounter [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Registered counter for database cinder Sep 16 22:25:26 devstack cinder-volume[82899]: DEBUG oslo_db.sqlalchemy.engines [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82899) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 22:25:26 devstack cinder-volume[82899]: DEBUG dbcounter [-] [82899] Writer thread running {{(pid=82899) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 22:25:26 devstack cinder-volume[82899]: INFO cinder.rpc [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 22:25:26 devstack cinder-volume[82899]: INFO cinder.rpc [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 22:25:26 devstack cinder-volume[82899]: DEBUG oslo_db.sqlalchemy.engines [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82899) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 22:25:27 devstack cinder-volume[82899]: INFO cinder.volume.manager [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Determined volume DB was empty at startup. Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG cinder.volume.manager [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82899) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 16 22:25:27 devstack cinder-volume[82899]: INFO cinder.volume.manager [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 22:25:27 devstack cinder-volume[82899]: WARNING stevedore.named [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 22:25:27 devstack cinder-volume[82899]: WARNING castellan.key_manager [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 22:25:27 devstack cinder-volume[82899]: WARNING cinder.keymgr.conf_key_mgr [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 22:25:27 devstack cinder-volume[82899]: INFO cinder.volume.manager [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_db.sqlalchemy.engines [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82899) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 22:25:27 devstack cinder-volume[82899]: INFO oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Starting 1 workers Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Started child 83223 {{(pid=82899) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 16 22:25:27 devstack cinder-volume[83223]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Full set of CONF: {{(pid=82899) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] ******************************************************************************** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Configuration options gathered from: {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] ================================================================================ {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] allow_availability_zone_fallback = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] allow_compression_on_image_upload = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] allowed_direct_url_schemes = [] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] api_rate_limit = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] auth_strategy = keystone {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_availability_zone = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_host = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_name = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_stats_polling_interval = 60 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backup_api_class = cinder.backup.api.API {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backup_name_template = backup-%s {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backup_use_same_host = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backup_use_temp_snapshot = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] chap_password = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] chap_username = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cinder_internal_tenant_project_id = 717789f1b97645f08a92dff2559bbcbd {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cinder_internal_tenant_user_id = 2abd804dbd7742f283186279ee88affe {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cluster = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] compression_format = gzip {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] compute_api_class = cinder.compute.nova.API {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] config_dir = [] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] config_source = [] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] control_exchange = openstack {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] debug = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] default_availability_zone = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] default_group_type = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] default_volume_type = QuobyteHD {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] driver_client_cert = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] driver_client_cert_key = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] driver_data_namespace = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] driver_ssl_cert_path = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] driver_ssl_cert_verify = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] driver_use_ssl = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] enable_new_services = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] enable_unsupported_driver = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] enabled_backends = ['QuobyteHD'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] enforce_multipath_for_image_xfer = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] filter_function = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] glance_api_insecure = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] glance_api_ssl_compression = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] glance_ca_certificates_file = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] glance_catalog_info = image:glance:publicURL {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] glance_certfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] glance_keyfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] glance_num_retries = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] glance_request_timeout = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] goodness_function = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] graceful_shutdown_timeout = 5 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] group_api_class = cinder.group.api.API {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] host = devstack {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] image_compress_on_upload = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] image_conversion_address_space_limit = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] image_conversion_cpu_limit = 60 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] image_conversion_disable = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] image_upload_use_cinder_backend = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] image_upload_use_internal_tenant = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] image_volume_cache_enabled = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] image_volume_cache_max_count = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] image_volume_cache_max_size_gb = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] init_host_max_objects_retrieval = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] instance_format = [instance: %(uuid)s] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] iscsi_iotype = fileio {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] iscsi_target_flags = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] iscsi_write_cache = on {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] iser_helper = tgtadm {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] iser_ip_address = 192.168.122.50 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] iser_port = 3260 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] log_color = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] log_config_append = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] log_dir = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] log_file = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] log_options = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] log_rotate_interval = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] log_rotate_interval_type = days {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] log_rotation_type = none {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] max_age = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] max_logfile_count = 30 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] max_logfile_size_mb = 200 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] max_over_subscription_ratio = 20.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] message_reap_interval = 86400 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] message_ttl = 2592000 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] migration_create_volume_timeout_secs = 300 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] monkey_patch = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] monkey_patch_modules = [] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] my_ip = 192.168.122.50 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] no_snapshot_gb_quota = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] num_iser_scan_tries = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] num_shell_tries = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] num_volume_device_scan_tries = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] nvmeof_conn_info_version = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] nvmet_ns_id = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] nvmet_port_id = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] osapi_max_limit = 1000 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] osapi_volume_ext_list = [] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] osapi_volume_listen = 0.0.0.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] osapi_volume_listen_port = 8776 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] osapi_volume_use_ssl = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] osapi_volume_workers = 2 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] per_volume_size_limit = -1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] periodic_fuzzy_delay = 60 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] periodic_interval = 60 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] project_id_regex = [0-9a-f\-]+ {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] public_endpoint = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] publish_errors = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] quota_backup_gigabytes = 1000 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] quota_backups = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] quota_gigabytes = 1000 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] quota_groups = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] quota_snapshots = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] quota_volumes = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] rate_limit_burst = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] rate_limit_except_level = CRITICAL {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] rate_limit_interval = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] reinit_driver_count = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] replication_device = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] report_discard_supported = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] report_interval = 120 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] reservation_clean_interval = 86400 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] reservation_expire = 86400 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] reserved_image_namespaces = [] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] reserved_percentage = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] rpc_response_timeout = 120 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] run_external_periodic_tasks = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] scst_target_driver = iscsi {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] scst_target_iqn_name = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_down_time = 720 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] shell_completion = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] snapshot_name_template = snapshot-%s {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] split_loggers = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] state_path = /opt/stack/data/cinder {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] storage_availability_zone = nova {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] storage_protocol = iSCSI {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] syslog_log_facility = LOG_USER {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] target_helper = lioadm {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] target_ip_address = 192.168.122.50 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] target_port = 3260 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] target_protocol = iscsi {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] target_secondary_ip_addresses = [] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] trace_flags = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] transfer_api_class = cinder.transfer.api.API {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] transport_url = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] until_refresh = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] use_chap_auth = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] use_default_quota_class = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] use_journal = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] use_json = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] use_multipath_for_image_xfer = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] use_stderr = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] use_syslog = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] verify_glance_signatures = enabled {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_api_class = cinder.volume.api.API {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_backend_name = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_clear = zero {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_clear_ionice = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_clear_size = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_copy_bps_limit = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_dd_blocksize = 1M {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_name_template = volume-%s {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_service_inithost_offload = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volume_usage_audit_period = month {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] watch_log_file = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] zoning_mode = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_concurrency.disable_process_locking = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.admin_password = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.admin_token = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.admin_user = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.auth_admin_prefix = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.auth_port = 35357 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.auth_protocol = https {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.auth_section = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.auth_type = password {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.auth_uri = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.auth_version = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.cache = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.certfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.delay_auth_decision = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.http_connect_timeout = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.identity_uri = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.include_service_catalog = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.insecure = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.interface = public {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.keyfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_password = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:25:27 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Starting volume driver QuobyteDriver (1.1.13) Sep 16 22:25:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3bc17172-56db-48dd-b360-512d49410573 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83223) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcache_username = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.region_name = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.service_token_roles_required = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.service_type = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.token_cache_time = 300 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.backend = dogpile.cache.null {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.backend_argument = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.backend_expiration_time = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.config_prefix = cache.oslo {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.dead_timeout = 60.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.debug_cache_backend = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.enable_retry_client = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.enable_socket_keepalive = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.enabled = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.enforce_fips_mode = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.expiration_time = 600 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.hashclient_retry_attempts = 2 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.hashclient_retry_delay = 1.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.memcache_dead_retry = 300 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.memcache_password = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.memcache_pool_maxsize = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.memcache_sasl_enabled = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.memcache_socket_timeout = 1.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.memcache_username = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.proxies = [] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.redis_db = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.redis_password = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.redis_sentinel_service_name = mymaster {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.redis_server = localhost:6379 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.redis_socket_timeout = 1.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.redis_username = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.retry_attempts = 2 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.retry_delay = 0.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.socket_keepalive_count = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.socket_keepalive_idle = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.socket_keepalive_interval = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.tls_allowed_ciphers = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.tls_cafile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.tls_certfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.tls_enabled = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cache.tls_keyfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] coordination.backend_url = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.asyncio_connection = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.asyncio_slave_connection = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.backend = sqlalchemy {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.connection = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.connection_debug = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.connection_parameters = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.connection_recycle_time = 3600 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.connection_trace = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.db_inc_retry_interval = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.db_max_retries = 20 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.db_max_retry_interval = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.db_retry_interval = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.max_overflow = 50 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.max_pool_size = 5 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.max_retries = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.mysql_wsrep_sync_wait = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.pool_timeout = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.retry_interval = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.slave_connection = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.sqlite_synchronous = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] database.use_db_reconnect = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.connection_string = messaging:// {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.enabled = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.es_doc_type = notification {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.es_scroll_size = 10000 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.es_scroll_time = 2m {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.filter_error_trace = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.hmac_keys = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.sentinel_service_name = mymaster {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.socket_timeout = 0.1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.trace_requests = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler.trace_sqlalchemy = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler_jaeger.process_tags = {} {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler_jaeger.service_name_prefix = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] profiler_otlp.service_name_prefix = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.enforce_new_defaults = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: WARNING oslo_config.cfg [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.enforce_scope = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.policy_default_rule = default {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.policy_file = policy.yaml {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_policy.remote_timeout = 60.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] privsep_osbrick.group = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] privsep_osbrick.helper_command = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] privsep_osbrick.user = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cinder_sys_admin.group = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cinder_sys_admin.helper_command = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] cinder_sys_admin.user = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_user.auth_section = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_user.auth_type = password {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_user.certfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_user.collect_timing = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_user.insecure = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_user.keyfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_user.send_service_user_token = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_user.split_loggers = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] service_user.timeout = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.backend_availability_zone = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.backend_host = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.chap_password = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.chap_username = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.driver_client_cert = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.driver_client_cert_key = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.driver_data_namespace = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.driver_use_ssl = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.enable_unsupported_driver = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.extra_capabilities = {} {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.filter_function = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.goodness_function = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.iscsi_iotype = fileio {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.iscsi_target_flags = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.iscsi_write_cache = on {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.iser_helper = tgtadm {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.iser_port = 3260 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nas_host = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nas_login = admin {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nas_mount_options = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nas_password = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nas_private_key = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nas_share_path = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nas_ssh_port = 22 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.num_shell_tries = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.nvmet_port_id = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.quobyte_client_cfg = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.quobyte_volume_url = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.replication_device = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.report_discard_supported = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.reserved_percentage = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.scst_target_driver = iscsi {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.scst_target_iqn_name = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.storage_protocol = iSCSI {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.target_helper = tgtadm {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.target_port = 3260 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.target_protocol = iscsi {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.trace_flags = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.unique_fqdn_network = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.use_chap_auth = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.volume_backend_name = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.volume_clear = zero {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.volume_clear_ionice = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.volume_clear_size = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_reports.file_event_handler = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_reports.log_dir = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.backend_availability_zone = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.backend_host = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.chap_password = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.chap_username = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.chiscsi_conf = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.driver_client_cert = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.driver_client_cert_key = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.driver_data_namespace = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.driver_use_ssl = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.extra_capabilities = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.filter_function = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.goodness_function = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:27 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.iscsi_iotype = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.iscsi_target_flags = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.iscsi_write_cache = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.iser_helper = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.iser_ip_address = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.iser_port = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.iser_target_prefix = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nas_host = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nas_login = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nas_mount_options = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nas_password = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nas_private_key = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nas_share_path = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nas_ssh_port = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.num_shell_tries = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nvmet_ns_id = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.nvmet_port_id = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.replication_device = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.report_discard_supported = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.reserved_percentage = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.scst_target_driver = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.storage_protocol = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.target_helper = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.target_ip_address = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.target_port = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.target_prefix = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.target_protocol = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.trace_flags = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.unique_fqdn_network = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.use_chap_auth = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.volume_clear = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.volume_clear_ionice = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.volume_clear_size = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] QuobyteHD.volumes_dir = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.ssl = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.ssl_version = {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17172-56db-48dd-b360-512d49410573 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83223) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_notifications.driver = [] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_notifications.retry = -1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[83223]: INFO cinder.volume.drivers.quobyte [None req-3bc17172-56db-48dd-b360-512d49410573 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] oslo_messaging_notifications.transport_url = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] key_manager.fixed_key = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.barbican_api_version = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.barbican_endpoint = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.barbican_endpoint_type = public {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.barbican_region_name = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.cafile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.certfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.collect_timing = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.insecure = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Running cmd (subprocess): mount.quobyte {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.keyfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.number_of_retries = 60 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.retry_delay = 1 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.send_service_user_token = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.split_loggers = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.timeout = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.verify_ssl = True {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican.verify_ssl_path = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican_service_user.auth_section = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican_service_user.auth_type = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican_service_user.cafile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican_service_user.certfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican_service_user.collect_timing = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican_service_user.insecure = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican_service_user.keyfile = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican_service_user.split_loggers = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] barbican_service_user.timeout = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.approle_role_id = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.approle_secret_id = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.kv_mountpoint = secret {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.kv_path = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.kv_version = 2 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.namespace = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.root_token_id = **** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.ssl_ca_crt_file = None {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.timeout = 60.0 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.use_ssl = False {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 22:25:28 devstack cinder-volume[82899]: DEBUG oslo_service.backend._eventlet.service [None req-9302deb9-2b05-4650-8f0e-c2c79e18fd1c None None] ******************************************************************************** {{(pid=82899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 16 22:25:28 devstack quobyte-client[83239]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 22:25:28 devstack quobyte-client[83239]: Invalid parameters found, error: missing mount point. Sep 16 22:25:28 devstack quobyte-client[83239]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 16 22:25:28 devstack quobyte-client[83239]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 16 22:25:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] CMD "mount.quobyte" returned: 1 in 0.380s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:25:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:25:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:25:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:25:28 devstack cinder-volume[83223]: INFO cinder.volume.drivers.quobyte [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Mounting volume: 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d ... Sep 16 22:25:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 -c /etc/quobyte/client-cinder.cfg {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:25:28 devstack quobyte-client[83245]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 16 22:25:28 devstack quobyte-client[83245]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 22:25:28 devstack quobyte-client[83245]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867' to display the log. Sep 16 22:25:28 devstack quobyte-client[83246]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 16 22:25:28 devstack quobyte-client[83246]: mount.quobyte 3.25 (4fbbd59204) Sep 16 22:25:28 devstack quobyte-client[83246]: Client UUID: k7hHLFM1-INcd-0uwU-sPv0-SjVkSaSOlRio Sep 16 22:25:28 devstack quobyte-client[83246]: Registry: osci01.corp.quobyte.com:7861 Sep 16 22:25:28 devstack quobyte-client[83246]: Volume: cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:25:28 devstack quobyte-client[83246]: FUSE version: 316 Sep 16 22:25:28 devstack quobyte-client[83246]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 16 22:25:28 devstack quobyte-client[83246]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 16 22:25:28 devstack quobyte-client[83246]: Setting total object cache size to 3352297472 bytes Sep 16 22:25:28 devstack quobyte-client[83246]: Using FUSE low-level API Sep 16 22:25:28 devstack quobyte-client[83246]: Caching of uid/gid to user/group name mappings is enabled Sep 16 22:25:28 devstack quobyte-client[83246]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 16 22:25:28 devstack quobyte-client[83246]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 16 22:25:28 devstack quobyte-client[83246]: HTTP server started on port 55000 Sep 16 22:25:28 devstack quobyte-client[83246]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 16 22:25:29 devstack quobyte-client[83246]: Mount point /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 established Sep 16 22:25:29 devstack quobyte-client[83246]: TimeSync is running and remote sync every 60 seconds Sep 16 22:25:29 devstack quobyte-client[83246]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 22:25:29 devstack quobyte-client[83246]: Ignored time synchronization message because time source took too long to respond (52 ms) Sep 16 22:25:29 devstack quobyte-client[83246]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 22:25:29 devstack quobyte-client[83246]: Opening volume cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d (2a1c750e-65ce-49b1-af1a-d5773877e950) Sep 16 22:25:29 devstack quobyte-client[83246]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 16 22:25:29 devstack quobyte-client[83246]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 22:25:29 devstack quobyte-client[83246]: Failed to invalidate inode: 38: Function not implemented Sep 16 22:25:29 devstack quobyte-client[83246]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 22:25:29 devstack quobyte-client[83246]: Automatic minidump upload enabled by global system configuration Sep 16 22:25:29 devstack quobyte-client[83246]: Announcing HTTP status server address 172.24.4.1 Sep 16 22:25:29 devstack quobyte-client[83246]: Registered as service (uuid k7hHLFM1-INcd-0uwU-sPv0-SjVkSaSOlRio) Sep 16 22:25:29 devstack quobyte-client[83246]: Quobyte Client running as pid 83246 Sep 16 22:25:29 devstack quobyte-client[83246]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 16 22:25:29 devstack quobyte-client[83246]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.691s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:25:29 devstack cinder-volume[83223]: INFO cinder.volume.drivers.quobyte [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Mounting volume: 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d succeeded Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.753s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:25:29 devstack quobyte-client[83246]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.082s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:25:29 devstack cinder-volume[83223]: INFO cinder.volume.driver [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG cinder.volume.driver [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9134864807129, 'free_capacity_gb': 924.9134864807129, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83223) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG oslo_db.sqlalchemy.engines [None req-3bc17172-56db-48dd-b360-512d49410573 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writer thread running {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG cinder.db.sqlalchemy.api [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Building query based on filter {{(pid=83223) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83223) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 16 22:25:29 devstack cinder-volume[83223]: INFO cinder.keymgr.migration [None req-59a31dae-8647-4681-9de0-c47bf4e6cd56 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.081s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:25:29 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:25:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Driver initialization completed successfully. Sep 16 22:25:30 devstack cinder-volume[83223]: INFO cinder.manager [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Initiating service 3 cleanup Sep 16 22:25:30 devstack cinder-volume[83223]: INFO cinder.manager [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Service 3 cleanup completed. Sep 16 22:25:30 devstack cinder-volume[83223]: DEBUG cinder.service [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Creating RPC server for service cinder-volume {{(pid=83223) start /opt/stack/cinder/cinder/service.py:239}} Sep 16 22:25:30 devstack cinder-volume[83223]: DEBUG cinder.service [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83223) start /opt/stack/cinder/cinder/service.py:245}} Sep 16 22:25:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 16 22:25:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:25:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:25:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:25:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:25:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:25:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:25:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:25:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:25:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bc17172-56db-48dd-b360-512d49410573 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.119s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:25:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3bc17172-56db-48dd-b360-512d49410573 None None] Driver post RPC initialization completed successfully. Sep 16 22:25:31 devstack quobyte-client[83246]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 22:25:37 devstack cinder-volume[82899]: DEBUG dbcounter [-] [82899] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82899) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:25:40 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:25:40 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:26:27 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:26:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:26:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:26:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:26:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:26:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:26:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:26:28 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:26:29 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:26:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Flow 'volume_create_manager' (93e5d7ec-8e34-4cf3-adbd-32a1df53c7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:26:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ca8aeb-7f81-4783-a47c-ff28df53813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ca8aeb-7f81-4783-a47c-ff28df53813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1452261430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594eb2c0-adb4-4620-908f-212a626b05dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa4f563e6e64a7dab4a7d0c3a60b306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:26:27Z,use_quota=True,user_id='d1fd3a66f02e4c23aadc6f032d7fbd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65fc782-978c-462c-bc35-a317c8564bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65fc782-978c-462c-bc35-a317c8564bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518902d0-49ce-4cf4-bf8b-c7658160ea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518902d0-49ce-4cf4-bf8b-c7658160ea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '594eb2c0-adb4-4620-908f-212a626b05dc', 'volume_name': 'volume-594eb2c0-adb4-4620-908f-212a626b05dc', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69223e9d-81ca-4ce9-80a6-da628bba4906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69223e9d-81ca-4ce9-80a6-da628bba4906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1331453a-0b19-4a57-9520-560b4e9d4c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:30 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Volume 594eb2c0-adb4-4620-908f-212a626b05dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-594eb2c0-adb4-4620-908f-212a626b05dc', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 22:26:30 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Cloning 594eb2c0-adb4-4620-908f-212a626b05dc from image 99ab3cef-3584-47a5-9dcc-19749e64ee70 at location (None, None). {{(pid=83223) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}} Sep 16 22:26:32 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD, size 20.69 MB, duration 1.18 sec {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 22:26:32 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Image download 20.69 MB at 17.47 MB/s Sep 16 22:26:32 devstack cinder-volume[83223]: INFO oslo.privsep.daemon [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu_uiuyya/privsep.sock'] Sep 16 22:26:32 devstack sudo[83572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu_uiuyya/privsep.sock Sep 16 22:26:32 devstack sudo[83572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:26:34 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Flow 'volume_create_manager' (b61ff7a7-173c-48a4-aba4-1fb5ad9fa415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b57560a-ab90-4cfd-8198-295db91f2208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b57560a-ab90-4cfd-8198-295db91f2208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-675731095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3ad182-8b87-451d-a358-8a49dbe3e652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25919754d56c43069f46bd49c5d126b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:26:34Z,use_quota=True,user_id='f48f0e69d24345aaa3a738ee590f5ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b307a75-9739-4c43-bf11-89c96f295151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b307a75-9739-4c43-bf11-89c96f295151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5cefba-b97e-4feb-82fa-9480dd3f6695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5cefba-b97e-4feb-82fa-9480dd3f6695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3ad182-8b87-451d-a358-8a49dbe3e652', 'volume_name': 'volume-8a3ad182-8b87-451d-a358-8a49dbe3e652', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cdec92-b204-4990-95c8-6bf2d133fd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cdec92-b204-4990-95c8-6bf2d133fd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c66168-61cc-4333-a188-bda74b350b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:34 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Volume 8a3ad182-8b87-451d-a358-8a49dbe3e652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3ad182-8b87-451d-a358-8a49dbe3e652', 'volume_size': 1} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-675731095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3ad182-8b87-451d-a358-8a49dbe3e652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25919754d56c43069f46bd49c5d126b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:26:34Z,use_quota=True,user_id='f48f0e69d24345aaa3a738ee590f5ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Creating volume 8a3ad182-8b87-451d-a358-8a49dbe3e652 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:26:34 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:26:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3ad182-8b87-451d-a358-8a49dbe3e652 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:34 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=2, name=volume-8a3ad182-8b87-451d-a358-8a49dbe3e652, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:26:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3ad182-8b87-451d-a358-8a49dbe3e652 1073741824" returned: 0 in 0.846s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3ad182-8b87-451d-a358-8a49dbe3e652 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3ad182-8b87-451d-a358-8a49dbe3e652" returned: 0 in 0.153s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] <== create_volume: return (1122ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:26:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:26:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c66168-61cc-4333-a188-bda74b350b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3ad182-8b87-451d-a358-8a49dbe3e652', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b76997-9c91-498b-9906-0ffe35638326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:35 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Volume volume-8a3ad182-8b87-451d-a358-8a49dbe3e652 (8a3ad182-8b87-451d-a358-8a49dbe3e652): created successfully Sep 16 22:26:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b76997-9c91-498b-9906-0ffe35638326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Flow 'volume_create_manager' (b61ff7a7-173c-48a4-aba4-1fb5ad9fa415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:26:35 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3dbf96fb-87ff-45d5-be34-12fb4ff4efb6 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Created volume successfully. Sep 16 22:26:37 devstack sudo[83572]: pam_unix(sudo:session): session closed for user root Sep 16 22:26:37 devstack cinder-volume[83223]: INFO oslo.privsep.daemon [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Spawned new privsep daemon via rootwrap Sep 16 22:26:37 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Accepted privsep connection to /tmp/tmpu_uiuyya/privsep.sock {{(pid=83223) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 16 22:26:37 devstack cinder-volume[83223]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 16 22:26:37 devstack cinder-volume[83223]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 16 22:26:37 devstack cinder-volume[83223]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 16 22:26:37 devstack cinder-volume[83223]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83896 Sep 16 22:26:37 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2fa43a-9645-4e6f-9ea5-d9fa455eed59]: (2,) {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:26:37 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f08f6-80da-44e7-bd24-eef9562f86bd]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:26:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:38 devstack sudo[83905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD Sep 16 22:26:38 devstack sudo[83905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:26:40 devstack sudo[83905]: pam_unix(sudo:session): session closed for user root Sep 16 22:26:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD" returned: 0 in 3.218s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:41 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Temporary image 99ab3cef-3584-47a5-9dcc-19749e64ee70 is fetched for user d1fd3a66f02e4c23aadc6f032d7fbd81. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 22:26:41 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadc66d4-46c1-452e-832b-f6c54dfac8e7]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:26:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:42 devstack sudo[83917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD Sep 16 22:26:42 devstack sudo[83917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:26:44 devstack sudo[83917]: pam_unix(sudo:session): session closed for user root Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD" returned: 0 in 2.545s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1452261430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594eb2c0-adb4-4620-908f-212a626b05dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa4f563e6e64a7dab4a7d0c3a60b306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:26:27Z,use_quota=True,user_id='d1fd3a66f02e4c23aadc6f032d7fbd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Creating volume 594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:26:44 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:44 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=3, name=volume-594eb2c0-adb4-4620-908f-212a626b05dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc 1073741824" returned: 0 in 0.398s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc" returned: 0 in 0.165s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] <== create_volume: return (685ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:26:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:26:45 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Attempting download of 99ab3cef-3584-47a5-9dcc-19749e64ee70 ((None, None)) to volume 594eb2c0-adb4-4620-908f-212a626b05dc. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 22:26:45 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d95100-9c2b-4f48-b9e1-4a7193da3abc]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:26:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_0w1fls2r {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_0w1fls2r" returned: 0 in 0.434s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_0w1fls2r {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_0w1fls2r" returned: 1 in 0.475s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_0w1fls2r' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:26:46 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[672a37f4-68ac-4e59-9c41-b5fcbf07a722]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:26:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD" returned: 0 in 1.149s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:47 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] 99ab3cef-3584-47a5-9dcc-19749e64ee70 was qcow2, converting to raw {{(pid=83223) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 22:26:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:48 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=3, name=volume-594eb2c0-adb4-4620-908f-212a626b05dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:26:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc" returned: 0 in 1.986s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:49 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70__ljgxgsmdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 22:26:49 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Converted 112.00 MB image at 52.72 MB/s Sep 16 22:26:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:50 devstack quobyte-client[83246]: System call of process 84004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:26:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc 1G" returned: 0 in 0.578s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:51 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8473f7eb-6e8f-4caa-b9c7-344d28d6c0c5]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:26:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc" returned: 0 in 1.501s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc" returned: 1 in 1.296s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:26:54 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Downloaded image 99ab3cef-3584-47a5-9dcc-19749e64ee70 ((None, None)) to volume 594eb2c0-adb4-4620-908f-212a626b05dc successfully. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 22:26:54 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Temporary image 99ab3cef-3584-47a5-9dcc-19749e64ee70 for user d1fd3a66f02e4c23aadc6f032d7fbd81 is deleted. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 22:26:54 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Marking volume 594eb2c0-adb4-4620-908f-212a626b05dc as bootable. {{(pid=83223) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 22:26:54 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Copying metadata from image 99ab3cef-3584-47a5-9dcc-19749e64ee70 to 594eb2c0-adb4-4620-908f-212a626b05dc. {{(pid=83223) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 22:26:54 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Creating volume glance metadata for volume 594eb2c0-adb4-4620-908f-212a626b05dc backed by image 99ab3cef-3584-47a5-9dcc-19749e64ee70 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83223) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 22:26:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1331453a-0b19-4a57-9520-560b4e9d4c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594eb2c0-adb4-4620-908f-212a626b05dc', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad8edeb-5567-4d3a-99ae-0f0046e2bd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:55 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Volume volume-594eb2c0-adb4-4620-908f-212a626b05dc (594eb2c0-adb4-4620-908f-212a626b05dc): created successfully Sep 16 22:26:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad8edeb-5567-4d3a-99ae-0f0046e2bd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Flow 'volume_create_manager' (93e5d7ec-8e34-4cf3-adbd-32a1df53c7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:26:55 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-59a740e1-aa99-4bb9-a274-913286228602 tempest-TaggedBootDevicesTest-1268064050 None] Created volume successfully. Sep 16 22:26:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Flow 'volume_create_manager' (cc468ffb-2cf2-4de3-91ca-4a1bf80b4d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bc6ef8-d5b0-48e2-a27f-5b4f7ee545bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bc6ef8-d5b0-48e2-a27f-5b4f7ee545bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1021853305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612f45ce-1267-4043-be33-4880b143b780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa4f563e6e64a7dab4a7d0c3a60b306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:26:58Z,use_quota=True,user_id='d1fd3a66f02e4c23aadc6f032d7fbd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a65a0da-24ce-497e-94dc-5a09367f7fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a65a0da-24ce-497e-94dc-5a09367f7fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deea5f02-8459-4044-a105-b0db13637114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deea5f02-8459-4044-a105-b0db13637114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612f45ce-1267-4043-be33-4880b143b780', 'volume_name': 'volume-612f45ce-1267-4043-be33-4880b143b780', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee5a63d-5889-447f-955e-3d4c818e81e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee5a63d-5889-447f-955e-3d4c818e81e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460db66b-f379-46d7-9771-e32e7ea9060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:26:57 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Volume 612f45ce-1267-4043-be33-4880b143b780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612f45ce-1267-4043-be33-4880b143b780', 'volume_size': 1} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:26:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1021853305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612f45ce-1267-4043-be33-4880b143b780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa4f563e6e64a7dab4a7d0c3a60b306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:26:58Z,use_quota=True,user_id='d1fd3a66f02e4c23aadc6f032d7fbd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Creating volume 612f45ce-1267-4043-be33-4880b143b780 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:26:58 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-612f45ce-1267-4043-be33-4880b143b780 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:58 devstack quobyte-client[83246]: System call of process 84036 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:26:58 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=4, name=volume-612f45ce-1267-4043-be33-4880b143b780, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-612f45ce-1267-4043-be33-4880b143b780 1073741824" returned: 0 in 0.868s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-612f45ce-1267-4043-be33-4880b143b780 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:26:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-612f45ce-1267-4043-be33-4880b143b780" returned: 0 in 0.496s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:26:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] <== create_volume: return (1518ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:26:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:27:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460db66b-f379-46d7-9771-e32e7ea9060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612f45ce-1267-4043-be33-4880b143b780', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aef4e01-b4ca-4b32-9b2b-1861399725ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:00 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Volume volume-612f45ce-1267-4043-be33-4880b143b780 (612f45ce-1267-4043-be33-4880b143b780): created successfully Sep 16 22:27:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aef4e01-b4ca-4b32-9b2b-1861399725ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Flow 'volume_create_manager' (cc468ffb-2cf2-4de3-91ca-4a1bf80b4d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:27:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7fb9146f-3885-4d2e-89c4-7494b407e481 tempest-TaggedBootDevicesTest-1268064050 None] Created volume successfully. Sep 16 22:27:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:27:01 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Flow 'volume_create_manager' (6ab87fc0-f971-4bdf-b37e-85da66407390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7297b6-ffce-4569-b7a1-5a971ea401f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7297b6-ffce-4569-b7a1-5a971ea401f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1136018869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6792e98b-51a2-4aa5-b12d-231dba85f174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3534ed1c159940ca91c9f1655bf54589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:27:02Z,use_quota=True,user_id='89c8ccd36cc242ccbcd6603ab7f4ef2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34677d6-7465-45f9-9080-e097798e24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34677d6-7465-45f9-9080-e097798e24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203e209a-0c75-456b-a01e-be91de98bc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203e209a-0c75-456b-a01e-be91de98bc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6792e98b-51a2-4aa5-b12d-231dba85f174', 'volume_name': 'volume-6792e98b-51a2-4aa5-b12d-231dba85f174', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25539a7-11de-4110-8c69-a994a075718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25539a7-11de-4110-8c69-a994a075718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb5eec5-1ba2-44f8-a3ec-d8c8e23479a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:02 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Volume 6792e98b-51a2-4aa5-b12d-231dba85f174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6792e98b-51a2-4aa5-b12d-231dba85f174', 'volume_size': 1} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1136018869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6792e98b-51a2-4aa5-b12d-231dba85f174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3534ed1c159940ca91c9f1655bf54589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:27:02Z,use_quota=True,user_id='89c8ccd36cc242ccbcd6603ab7f4ef2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Creating volume 6792e98b-51a2-4aa5-b12d-231dba85f174 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:27:02 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:27:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6792e98b-51a2-4aa5-b12d-231dba85f174 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:27:02 devstack quobyte-client[83246]: System call of process 84050 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:27:02 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=5, name=volume-6792e98b-51a2-4aa5-b12d-231dba85f174, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:27:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6792e98b-51a2-4aa5-b12d-231dba85f174 1073741824" returned: 0 in 1.030s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:27:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6792e98b-51a2-4aa5-b12d-231dba85f174 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:27:03 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:27:03 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:27:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Flow 'volume_create_manager' (1a21410b-ec90-44af-b83c-faa4fd59d03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:27:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20bef8c-2dc8-44fe-9479-085ac59fe62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20bef8c-2dc8-44fe-9479-085ac59fe62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1367452202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10caaac-1b68-4e78-9c02-0cafa950cec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa4f563e6e64a7dab4a7d0c3a60b306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:27:03Z,use_quota=True,user_id='d1fd3a66f02e4c23aadc6f032d7fbd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77822255-3b82-4d74-ab1d-54fafd2c0c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77822255-3b82-4d74-ab1d-54fafd2c0c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a94cbab-f82e-4774-bf73-851b4b8c4654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a94cbab-f82e-4774-bf73-851b4b8c4654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a10caaac-1b68-4e78-9c02-0cafa950cec6', 'volume_name': 'volume-a10caaac-1b68-4e78-9c02-0cafa950cec6', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41292c7-bee0-4b36-9e56-49fca3a980ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41292c7-bee0-4b36-9e56-49fca3a980ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca945516-f89e-4746-a826-b2f1409c3ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:04 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Volume a10caaac-1b68-4e78-9c02-0cafa950cec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a10caaac-1b68-4e78-9c02-0cafa950cec6', 'volume_size': 1} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6792e98b-51a2-4aa5-b12d-231dba85f174" returned: 0 in 1.036s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] <== create_volume: return (2118ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1367452202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10caaac-1b68-4e78-9c02-0cafa950cec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa4f563e6e64a7dab4a7d0c3a60b306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:27:03Z,use_quota=True,user_id='d1fd3a66f02e4c23aadc6f032d7fbd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Creating volume a10caaac-1b68-4e78-9c02-0cafa950cec6 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:27:04 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:27:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a10caaac-1b68-4e78-9c02-0cafa950cec6 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:27:04 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=6, name=volume-a10caaac-1b68-4e78-9c02-0cafa950cec6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:27:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb5eec5-1ba2-44f8-a3ec-d8c8e23479a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6792e98b-51a2-4aa5-b12d-231dba85f174', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012021c7-fa25-47ce-9636-be53aac91e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a10caaac-1b68-4e78-9c02-0cafa950cec6 1073741824" returned: 0 in 1.052s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:27:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a10caaac-1b68-4e78-9c02-0cafa950cec6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:27:05 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Volume volume-6792e98b-51a2-4aa5-b12d-231dba85f174 (6792e98b-51a2-4aa5-b12d-231dba85f174): created successfully Sep 16 22:27:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012021c7-fa25-47ce-9636-be53aac91e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Flow 'volume_create_manager' (6ab87fc0-f971-4bdf-b37e-85da66407390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:27:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a10caaac-1b68-4e78-9c02-0cafa950cec6" returned: 0 in 0.952s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:27:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] <== create_volume: return (2044ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:27:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:27:06 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3833e079-386e-4baf-8fb9-1f17dac69f72 tempest-DeleteServersTestJSON-857959716 None] Created volume successfully. Sep 16 22:27:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca945516-f89e-4746-a826-b2f1409c3ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a10caaac-1b68-4e78-9c02-0cafa950cec6', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f781cd5-02da-43d3-911b-68bc0f5e7d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:27:06 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Volume volume-a10caaac-1b68-4e78-9c02-0cafa950cec6 (a10caaac-1b68-4e78-9c02-0cafa950cec6): created successfully Sep 16 22:27:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f781cd5-02da-43d3-911b-68bc0f5e7d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:27:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Flow 'volume_create_manager' (1a21410b-ec90-44af-b83c-faa4fd59d03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:27:06 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-09c45b77-2992-4c96-9d7b-ba6310a11404 tempest-TaggedBootDevicesTest-1268064050 None] Created volume successfully. Sep 16 22:27:16 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=6 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:27:16 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:INSERT=7,cinder:DELETE=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:27:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-6ab250ef-b61c-4165-a9f5-3d226089d868 req-60f54977-e2c4-4912-83bd-af3b54229ae4 tempest-DeleteServersTestJSON-857959716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:27:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-6ab250ef-b61c-4165-a9f5-3d226089d868 req-60f54977-e2c4-4912-83bd-af3b54229ae4 tempest-DeleteServersTestJSON-857959716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:27:36 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec0f7b6-8230-4d89-a4e8-a0fb658193ef]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:27:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-6ab250ef-b61c-4165-a9f5-3d226089d868 req-60f54977-e2c4-4912-83bd-af3b54229ae4 tempest-DeleteServersTestJSON-857959716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6792e98b-51a2-4aa5-b12d-231dba85f174 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:27:37 devstack quobyte-client[83246]: System call of process 84271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:27:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-6ab250ef-b61c-4165-a9f5-3d226089d868 req-60f54977-e2c4-4912-83bd-af3b54229ae4 tempest-DeleteServersTestJSON-857959716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6792e98b-51a2-4aa5-b12d-231dba85f174" returned: 0 in 1.178s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:27:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-6ab250ef-b61c-4165-a9f5-3d226089d868 req-60f54977-e2c4-4912-83bd-af3b54229ae4 tempest-DeleteServersTestJSON-857959716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.274s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:27:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-6ab250ef-b61c-4165-a9f5-3d226089d868 req-60f54977-e2c4-4912-83bd-af3b54229ae4 tempest-DeleteServersTestJSON-857959716 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-6792e98b-51a2-4aa5-b12d-231dba85f174', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e156f1e-8258-4e53-8758-6257515d9b7d', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:27:38 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-6ab250ef-b61c-4165-a9f5-3d226089d868 req-60f54977-e2c4-4912-83bd-af3b54229ae4 tempest-DeleteServersTestJSON-857959716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:27:38 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-6ab250ef-b61c-4165-a9f5-3d226089d868 req-60f54977-e2c4-4912-83bd-af3b54229ae4 tempest-DeleteServersTestJSON-857959716 None] attachment_update completed successfully. Sep 16 22:27:48 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:27:48 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:27:56 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-d8b62067-5766-4eac-b228-e96805b1138a req-d52472fc-2e01-4234-bb6a-bf6264e6e163 tempest-DeleteServersTestJSON-857959716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:27:56 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-d8b62067-5766-4eac-b228-e96805b1138a req-d52472fc-2e01-4234-bb6a-bf6264e6e163 tempest-DeleteServersTestJSON-857959716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:27:56 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-d8b62067-5766-4eac-b228-e96805b1138a req-d52472fc-2e01-4234-bb6a-bf6264e6e163 tempest-DeleteServersTestJSON-857959716 None] Terminate volume connection completed successfully. Sep 16 22:27:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-d8b62067-5766-4eac-b228-e96805b1138a req-d52472fc-2e01-4234-bb6a-bf6264e6e163 tempest-DeleteServersTestJSON-857959716 None] Deleting attachment 3e156f1e-8258-4e53-8758-6257515d9b7d. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:28:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Acquiring lock "cinder-6792e98b-51a2-4aa5-b12d-231dba85f174-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:28:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Lock "cinder-6792e98b-51a2-4aa5-b12d-231dba85f174-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:28:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:28:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Acquiring lock "cinder-quobyte-6792e98b-51a2-4aa5-b12d-231dba85f174" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:28:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Lock "cinder-quobyte-6792e98b-51a2-4aa5-b12d-231dba85f174" acquired by "delete_volume" :: waited 0.027s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:28:02 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd6a34e-736b-42d5-9bd9-5df395140569]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:28:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6792e98b-51a2-4aa5-b12d-231dba85f174 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:03 devstack quobyte-client[83246]: System call of process 84802 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:28:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6792e98b-51a2-4aa5-b12d-231dba85f174" returned: 0 in 0.773s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6792e98b-51a2-4aa5-b12d-231dba85f174 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6792e98b-51a2-4aa5-b12d-231dba85f174" returned: 0 in 0.158s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Lock "cinder-quobyte-6792e98b-51a2-4aa5-b12d-231dba85f174" released by "delete_volume" :: held 1.259s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:28:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:04 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[be862d74-9d78-48f0-918c-eaebf3377e60]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:28:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:04 devstack cinder-volume[83223]: WARNING cinder.quota [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:28:04 devstack cinder-volume[83223]: WARNING cinder.quota [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:28:04 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Created reservations ['fee6429f-ceaa-473c-9d66-70fd220b5e36', '998503a3-5e0b-4653-a6ab-7ff06f4ef93e', '9e047b63-195c-4750-a3ef-867ae68232e6', '7109ebd2-950b-441a-aeb0-3c226fdd82db'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:28:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc" returned: 0 in 0.699s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.108s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:28:05 devstack quobyte-client[83246]: System call of process 84810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:28:05 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Deleted volume successfully. Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc" returned: 1 in 0.762s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.563s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-594eb2c0-adb4-4620-908f-212a626b05dc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a61d13fe-52de-48c3-a2ae-922e72ccf84e', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:28:05 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:28:05 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a65b2ada-3675-40ff-aa6d-3377e8b75aed tempest-DeleteServersTestJSON-857959716 None] Lock "cinder-6792e98b-51a2-4aa5-b12d-231dba85f174-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:28:06 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-501ad897-db6f-4f4b-bb55-fc0730517e8f tempest-TaggedBootDevicesTest-1268064050 None] attachment_update completed successfully. Sep 16 22:28:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-57e2a5ed-4b66-493b-997d-43b973d03408 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-57e2a5ed-4b66-493b-997d-43b973d03408 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:09 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[41481423-f34f-4078-99ae-d5da253d308e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:28:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-57e2a5ed-4b66-493b-997d-43b973d03408 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-612f45ce-1267-4043-be33-4880b143b780 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:10 devstack quobyte-client[83246]: System call of process 84825 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:28:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-57e2a5ed-4b66-493b-997d-43b973d03408 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-612f45ce-1267-4043-be33-4880b143b780" returned: 0 in 1.082s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-57e2a5ed-4b66-493b-997d-43b973d03408 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.194s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-57e2a5ed-4b66-493b-997d-43b973d03408 tempest-TaggedBootDevicesTest-1268064050 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-612f45ce-1267-4043-be33-4880b143b780', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1ee6737-36ff-47cc-ac7a-56f10c9c43d3', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:28:10 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-57e2a5ed-4b66-493b-997d-43b973d03408 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:28:11 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-57e2a5ed-4b66-493b-997d-43b973d03408 tempest-TaggedBootDevicesTest-1268064050 None] attachment_update completed successfully. Sep 16 22:28:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-f1625520-90e6-4824-bd28-4c9984145be8 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-f1625520-90e6-4824-bd28-4c9984145be8 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:14 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a796d12-333c-4fb7-99cf-66b72face285]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:28:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-f1625520-90e6-4824-bd28-4c9984145be8 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a10caaac-1b68-4e78-9c02-0cafa950cec6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-f1625520-90e6-4824-bd28-4c9984145be8 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a10caaac-1b68-4e78-9c02-0cafa950cec6" returned: 0 in 1.268s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-f1625520-90e6-4824-bd28-4c9984145be8 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.586s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-f1625520-90e6-4824-bd28-4c9984145be8 tempest-TaggedBootDevicesTest-1268064050 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-a10caaac-1b68-4e78-9c02-0cafa950cec6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c12fbbd-32a1-423a-bf2c-7bef8c46d111', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:28:16 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-f1625520-90e6-4824-bd28-4c9984145be8 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:28:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-03290c7e-9e09-4a5d-bb9a-17286733891f req-f1625520-90e6-4824-bd28-4c9984145be8 tempest-TaggedBootDevicesTest-1268064050 None] attachment_update completed successfully. Sep 16 22:28:19 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Flow 'volume_create_manager' (62ba9cb6-2d3f-4891-a9ec-cd77c4be1a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c174ffd0-7263-4829-99dd-1c79def6e86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c174ffd0-7263-4829-99dd-1c79def6e86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1747294665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8236ba46-a7fd-44bb-b595-1d9991720b04,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95ca0c72eb5949e2b35f8fc62ab8b29d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:28:19Z,use_quota=True,user_id='0f5625b68c164700be874e7b5a4b0f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79457342-f4e3-4d90-8aae-9c6c3c9c18f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79457342-f4e3-4d90-8aae-9c6c3c9c18f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed03da8d-e3a6-49ca-915b-bc3d01e02c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed03da8d-e3a6-49ca-915b-bc3d01e02c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8236ba46-a7fd-44bb-b595-1d9991720b04', 'volume_name': 'volume-8236ba46-a7fd-44bb-b595-1d9991720b04', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab2ae7e-418e-4b99-9d6b-a49e97433b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab2ae7e-418e-4b99-9d6b-a49e97433b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3a16d3-790a-491b-9be5-810df41dd575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:19 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Volume 8236ba46-a7fd-44bb-b595-1d9991720b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8236ba46-a7fd-44bb-b595-1d9991720b04', 'volume_size': 1} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1747294665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8236ba46-a7fd-44bb-b595-1d9991720b04,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95ca0c72eb5949e2b35f8fc62ab8b29d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:28:19Z,use_quota=True,user_id='0f5625b68c164700be874e7b5a4b0f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Creating volume 8236ba46-a7fd-44bb-b595-1d9991720b04 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:28:19 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8236ba46-a7fd-44bb-b595-1d9991720b04 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:19 devstack quobyte-client[83246]: System call of process 84896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:28:19 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=7, name=volume-8236ba46-a7fd-44bb-b595-1d9991720b04, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8236ba46-a7fd-44bb-b595-1d9991720b04 1073741824" returned: 0 in 0.413s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8236ba46-a7fd-44bb-b595-1d9991720b04 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8236ba46-a7fd-44bb-b595-1d9991720b04" returned: 0 in 0.154s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] <== create_volume: return (718ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:28:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3a16d3-790a-491b-9be5-810df41dd575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8236ba46-a7fd-44bb-b595-1d9991720b04', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8930b68b-8307-405b-bd45-72e6e175bab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:20 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Volume volume-8236ba46-a7fd-44bb-b595-1d9991720b04 (8236ba46-a7fd-44bb-b595-1d9991720b04): created successfully Sep 16 22:28:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8930b68b-8307-405b-bd45-72e6e175bab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Flow 'volume_create_manager' (62ba9cb6-2d3f-4891-a9ec-cd77c4be1a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:28:20 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-410ca9bb-f624-4dc9-9cb4-e9e64c353c83 req-bee5a7a8-25c7-4a85-9d5e-c1aec46e3c22 tempest-VolumesGetTestJSON-460073828 None] Created volume successfully. Sep 16 22:28:21 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Acquiring lock "cinder-8236ba46-a7fd-44bb-b595-1d9991720b04-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:28:21 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Lock "cinder-8236ba46-a7fd-44bb-b595-1d9991720b04-delete_volume" acquired by "delete_volume" :: waited 0.147s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:28:22 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:28:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Acquiring lock "cinder-quobyte-8236ba46-a7fd-44bb-b595-1d9991720b04" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:28:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Lock "cinder-quobyte-8236ba46-a7fd-44bb-b595-1d9991720b04" acquired by "delete_volume" :: waited 0.042s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:28:22 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[75775970-8968-49d7-b8ba-df4b81c2f144]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:28:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8236ba46-a7fd-44bb-b595-1d9991720b04 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8236ba46-a7fd-44bb-b595-1d9991720b04" returned: 0 in 0.859s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8236ba46-a7fd-44bb-b595-1d9991720b04 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8236ba46-a7fd-44bb-b595-1d9991720b04" returned: 0 in 0.107s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Lock "cinder-quobyte-8236ba46-a7fd-44bb-b595-1d9991720b04" released by "delete_volume" :: held 1.103s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG cinder.quota [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Created reservations ['3379444c-a506-486f-bb5f-f1c669bba7fb', 'b201906c-f9c9-46e1-af36-d49424877e10', '470a9a42-dae3-48c3-964c-d20af5f97ca8', 'f8dd25cc-b159-4e65-a2a8-d120c25a6182'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.087s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:23 devstack cinder-volume[83223]: DEBUG cinder.manager [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:28:23 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Deleted volume successfully. Sep 16 22:28:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-d3b45809-0c5b-4c31-b220-7dfa0460cf52 req-1363fa38-3974-4f15-acf3-6655c0ad8f60 tempest-VolumesGetTestJSON-460073828 None] Lock "cinder-8236ba46-a7fd-44bb-b595-1d9991720b04-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:28:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:28:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:28:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:28:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.167s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:28:33 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=32,cinder:UPDATE=22,cinder:INSERT=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:28:33 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=25,cinder:INSERT=4,cinder:UPDATE=23,cinder:DELETE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:28:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-7d941fed-e985-44b5-b999-90c839147407 req-01beac4c-94bd-468a-b518-4628d35ae22b tempest-VolumesAssistedSnapshotsTest-1292972098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-7d941fed-e985-44b5-b999-90c839147407 req-01beac4c-94bd-468a-b518-4628d35ae22b tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.023s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:38 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb8ed03-ea86-4852-b5b7-f43c76094b67]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:28:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-7d941fed-e985-44b5-b999-90c839147407 req-01beac4c-94bd-468a-b518-4628d35ae22b tempest-VolumesAssistedSnapshotsTest-1292972098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3ad182-8b87-451d-a358-8a49dbe3e652 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-7d941fed-e985-44b5-b999-90c839147407 req-01beac4c-94bd-468a-b518-4628d35ae22b tempest-VolumesAssistedSnapshotsTest-1292972098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3ad182-8b87-451d-a358-8a49dbe3e652" returned: 0 in 0.642s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-7d941fed-e985-44b5-b999-90c839147407 req-01beac4c-94bd-468a-b518-4628d35ae22b tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.747s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-7d941fed-e985-44b5-b999-90c839147407 req-01beac4c-94bd-468a-b518-4628d35ae22b tempest-VolumesAssistedSnapshotsTest-1292972098 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-8a3ad182-8b87-451d-a358-8a49dbe3e652', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21b218d1-e515-48eb-994b-94e00da411de', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:28:39 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-7d941fed-e985-44b5-b999-90c839147407 req-01beac4c-94bd-468a-b518-4628d35ae22b tempest-VolumesAssistedSnapshotsTest-1292972098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:28:39 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-7d941fed-e985-44b5-b999-90c839147407 req-01beac4c-94bd-468a-b518-4628d35ae22b tempest-VolumesAssistedSnapshotsTest-1292972098 None] attachment_update completed successfully. Sep 16 22:28:49 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:28:49 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:28:53 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Flow 'volume_create_manager' (078c95d6-e2a5-49b5-a917-4b850344893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba6fa58-944a-46d5-9a2a-e4d042ba79bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba6fa58-944a-46d5-9a2a-e4d042ba79bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1078764598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828584ba-4dce-4468-a5ba-565e2a69addc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9abe7e7958c947d19e7078a77375e51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:28:53Z,use_quota=True,user_id='6b9deb4efd934e4ab0eafb3635436ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a286355-30cd-450c-91f7-dc7137558ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a286355-30cd-450c-91f7-dc7137558ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc64d9b9-b91b-4369-80fb-19ed96d1c391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc64d9b9-b91b-4369-80fb-19ed96d1c391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828584ba-4dce-4468-a5ba-565e2a69addc', 'volume_name': 'volume-828584ba-4dce-4468-a5ba-565e2a69addc', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270d9b17-14db-45bc-a65b-f4a488a9cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270d9b17-14db-45bc-a65b-f4a488a9cd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f3c290-bb1d-431b-958b-b554e656feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:53 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Volume 828584ba-4dce-4468-a5ba-565e2a69addc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828584ba-4dce-4468-a5ba-565e2a69addc', 'volume_size': 1} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1078764598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828584ba-4dce-4468-a5ba-565e2a69addc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9abe7e7958c947d19e7078a77375e51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:28:53Z,use_quota=True,user_id='6b9deb4efd934e4ab0eafb3635436ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Creating volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:28:53 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:28:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:54 devstack quobyte-client[83246]: System call of process 85740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:28:54 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=8, name=volume-828584ba-4dce-4468-a5ba-565e2a69addc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:28:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc 1073741824" returned: 0 in 0.787s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc" returned: 0 in 0.322s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] <== create_volume: return (1277ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:28:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:28:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f3c290-bb1d-431b-958b-b554e656feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828584ba-4dce-4468-a5ba-565e2a69addc', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b239438b-ba04-4e30-97b4-b9984f79e058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:28:56 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Volume volume-828584ba-4dce-4468-a5ba-565e2a69addc (828584ba-4dce-4468-a5ba-565e2a69addc): created successfully Sep 16 22:28:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b239438b-ba04-4e30-97b4-b9984f79e058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:28:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Flow 'volume_create_manager' (078c95d6-e2a5-49b5-a917-4b850344893e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:28:56 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-24eb3242-7780-4f89-ab0a-7de05b3d7dcc tempest-SnapshotsActionsTest-1483353926 None] Created volume successfully. Sep 16 22:28:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:28:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:28:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:28:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Creating offline snapshot 4dc332be-2e70-4900-b0f7-5380b5520e64 of volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:28:57 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea84e8bf-55bf-4195-b9a0-506289355e2e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:28:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc" returned: 0 in 0.990s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:28:59 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=9, name=volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:28:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 1G" returned: 0 in 0.589s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:28:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img rebase -u -b volume-828584ba-4dce-4468-a5ba-565e2a69addc -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:00 devstack quobyte-client[83246]: System call of process 85780 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img rebase -u -b volume-828584ba-4dce-4468-a5ba-565e2a69addc -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.332s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:29:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.358s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:29:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.379s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.info" returned: 0 in 0.183s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:29:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.info" returned: 0 in 0.113s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.903s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:02 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-77e82e55-0bc4-4a5a-b043-78c127dc1b1f tempest-SnapshotsActionsTest-1483353926 None] Create snapshot completed successfully Sep 16 22:29:04 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Creating offline snapshot eb337b06-7195-4d3b-bbeb-d68afeb1e628 of volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:29:04 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[045477ce-8628-462f-b8a3-d9e0bfb31783]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.819s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:05 devstack quobyte-client[83246]: System call of process 85827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:05 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=11, name=volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:29:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628 1G" returned: 0 in 0.553s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img rebase -u -b volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:05 devstack quobyte-client[83246]: System call of process 85834 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img rebase -u -b volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628" returned: 0 in 0.207s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:29:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628" returned: 0 in 0.107s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:29:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628" returned: 0 in 0.176s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:06 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-4ee9f082-4c8c-4cb7-9bfc-a677c20b9172 tempest-SnapshotsActionsTest-1483353926 None] Create snapshot completed successfully Sep 16 22:29:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-eb337b06-7195-4d3b-bbeb-d68afeb1e628-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-eb337b06-7195-4d3b-bbeb-d68afeb1e628-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" acquired by "delete_snapshot" :: waited 0.063s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-quobyte-eb337b06-7195-4d3b-bbeb-d68afeb1e628" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-eb337b06-7195-4d3b-bbeb-d68afeb1e628" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Deleting offline snapshot eb337b06-7195-4d3b-bbeb-d68afeb1e628 of volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:29:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] snapshot_file for this snap is: volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:29:07 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ca4a02-9ff6-490b-98c4-19e66f484494]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628" returned: 0 in 0.723s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:08 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[473e494b-59c4-48b2-833b-cd1f4d507e9a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.398s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628" returned: 0 in 0.239s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.eb337b06-7195-4d3b-bbeb-d68afeb1e628" returned: 0 in 0.091s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-eb337b06-7195-4d3b-bbeb-d68afeb1e628" released by "_delete_snapshot" :: held 1.763s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" released by "delete_snapshot" :: held 1.821s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:09 devstack cinder-volume[83223]: WARNING cinder.quota [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:29:09 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Created reservations ['510f9099-856d-485c-87f8-7fb6725fd7bd', '971d7d13-0606-4022-aa33-facb4afc907b', '1f6c9544-4bc1-4d31-93fa-2d7f428b5363', '00ba916f-efef-4ce5-ab9d-fe17fe5cf670'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:29:10 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Delete snapshot completed successfully. Sep 16 22:29:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a7671425-3ff3-443c-ac1f-9b799e3799d9 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-eb337b06-7195-4d3b-bbeb-d68afeb1e628-delete_snapshot" released by "delete_snapshot" :: held 2.377s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Creating offline snapshot b7c20016-d4aa-4816-9aa8-9064e4282401 of volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:29:11 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da75707-09a4-43f7-90b5-13648f9a092c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.362s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:11 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=12, name=volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:29:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401 1G" returned: 0 in 0.220s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img rebase -u -b volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img rebase -u -b volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401" returned: 0 in 0.125s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:29:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401" returned: 0 in 0.102s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:29:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401" returned: 0 in 0.079s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.139s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0ecb0243-9183-4044-8e0b-35b03a0ad4cb tempest-SnapshotsActionsTest-1483353926 None] Create snapshot completed successfully Sep 16 22:29:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-b7c20016-d4aa-4816-9aa8-9064e4282401-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-b7c20016-d4aa-4816-9aa8-9064e4282401-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:13 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-quobyte-b7c20016-d4aa-4816-9aa8-9064e4282401" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-b7c20016-d4aa-4816-9aa8-9064e4282401" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Deleting offline snapshot b7c20016-d4aa-4816-9aa8-9064e4282401 of volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:29:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] snapshot_file for this snap is: volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:29:13 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0373e74d-9a5d-4f76-888a-fa29906ee823]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401" returned: 0 in 0.392s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:14 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[55687aee-bf93-42c4-8655-3264e10f64cc]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:14 devstack quobyte-client[83246]: System call of process 85882 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.390s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:14 devstack quobyte-client[83246]: System call of process 85885 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401" returned: 0 in 0.275s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.b7c20016-d4aa-4816-9aa8-9064e4282401" returned: 0 in 0.095s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-b7c20016-d4aa-4816-9aa8-9064e4282401" released by "_delete_snapshot" :: held 1.478s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" released by "delete_snapshot" :: held 1.497s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:15 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Created reservations ['9f5f6775-b06b-4d0c-8112-ed01b8c97f84', 'a6350776-8d76-4afa-9987-29e60bbb2195', 'a362e7ec-02e6-41a2-8a8a-63dacd21eddf', '1d747e24-1374-4b9a-89cd-ce2cc7b7b2e8'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:29:15 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Delete snapshot completed successfully. Sep 16 22:29:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f7aa1a3-98c3-465a-8613-09fae4fa3d5f tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-b7c20016-d4aa-4816-9aa8-9064e4282401-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:16 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Creating offline snapshot 465f9a05-b474-4d3e-927b-737273fada49 of volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:29:16 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[868c8069-50b5-4b40-a1af-66fc42db332e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:16 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-1410121f-113f-486d-977a-9bdbb6d010a8 req-1e5e373b-1c2a-4284-9244-739b66f28220 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:17 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-1410121f-113f-486d-977a-9bdbb6d010a8 req-1e5e373b-1c2a-4284-9244-739b66f28220 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-1410121f-113f-486d-977a-9bdbb6d010a8 req-1e5e373b-1c2a-4284-9244-739b66f28220 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Terminate volume connection completed successfully. Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-1410121f-113f-486d-977a-9bdbb6d010a8 req-1e5e373b-1c2a-4284-9244-739b66f28220 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Deleting attachment 21b218d1-e515-48eb-994b-94e00da411de. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.928s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:17 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=13, name=volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49 1G" returned: 0 in 0.327s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img rebase -u -b volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:17 devstack quobyte-client[83246]: System call of process 85928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img rebase -u -b volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49" returned: 0 in 0.179s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49" returned: 0 in 0.103s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:29:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:18 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ef4c937c-b3cc-4377-aafb-3418118108b5 tempest-SnapshotsActionsTest-1483353926 None] Create snapshot completed successfully Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Acquiring lock "cinder-8a3ad182-8b87-451d-a358-8a49dbe3e652-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "cinder-8a3ad182-8b87-451d-a358-8a49dbe3e652-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:19 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Acquiring lock "cinder-quobyte-8a3ad182-8b87-451d-a358-8a49dbe3e652" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-465f9a05-b474-4d3e-927b-737273fada49-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "cinder-quobyte-8a3ad182-8b87-451d-a358-8a49dbe3e652" acquired by "delete_volume" :: waited 0.044s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-465f9a05-b474-4d3e-927b-737273fada49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:19 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8d274-f7e0-4540-8cc6-5485f5f4932d]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3ad182-8b87-451d-a358-8a49dbe3e652 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" acquired by "delete_snapshot" :: waited 0.153s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-quobyte-465f9a05-b474-4d3e-927b-737273fada49" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-465f9a05-b474-4d3e-927b-737273fada49" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Deleting offline snapshot 465f9a05-b474-4d3e-927b-737273fada49 of volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] snapshot_file for this snap is: volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b377a7-8e0c-44fd-baf1-87998f6c02d9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49" returned: 0 in 0.422s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:20 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[273eb62a-212d-406f-bf58-d94003cc5dac]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:20 devstack quobyte-client[83246]: System call of process 85933 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3ad182-8b87-451d-a358-8a49dbe3e652" returned: 0 in 0.942s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3ad182-8b87-451d-a358-8a49dbe3e652 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3ad182-8b87-451d-a358-8a49dbe3e652" returned: 0 in 0.114s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:20 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "cinder-quobyte-8a3ad182-8b87-451d-a358-8a49dbe3e652" released by "delete_volume" :: held 1.242s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:21 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Created reservations ['2c98f568-65de-416f-a462-aca6a816f107', '6b1e7103-a1f0-4316-b9a0-adebbf166fd5', '8bd71b70-7115-4d31-ad95-68053ef5365d', '185439f0-3370-4f25-9b00-8566b11a1c97'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:29:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.854s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49" returned: 0 in 0.305s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.465f9a05-b474-4d3e-927b-737273fada49" returned: 0 in 0.296s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-465f9a05-b474-4d3e-927b-737273fada49" released by "_delete_snapshot" :: held 2.158s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" released by "delete_snapshot" :: held 2.240s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.255s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:29:22 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Deleted volume successfully. Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-46ae0fce-6fcf-4090-84c3-1dd1d9a8fa20 tempest-VolumesAssistedSnapshotsTest-1292972098 None] Lock "cinder-8a3ad182-8b87-451d-a358-8a49dbe3e652-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Created reservations ['ef87dd6d-0599-45ef-92b5-f9933642550b', 'e4a1dad8-4da9-424a-9712-88c22266395c', '3d13141a-1d32-49ce-b1ae-ad50190ced94', '2ce7d1a8-85ef-41c5-9e56-7ca71e3d7fbc'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:29:22 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Delete snapshot completed successfully. Sep 16 22:29:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c6efb06d-4685-4a6e-8cd3-e97b7c1f9cc0 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-465f9a05-b474-4d3e-927b-737273fada49-delete_snapshot" released by "delete_snapshot" :: held 3.240s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:24 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Creating offline snapshot 90716db1-2c68-48f8-a4f4-fd85a2cc2889 of volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:29:25 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8083b84-41b2-4b8c-8bde-5a4e63404d9f]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 1.327s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:26 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=14, name=volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:29:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889 1G" returned: 0 in 0.256s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img rebase -u -b volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img rebase -u -b volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889" returned: 0 in 0.298s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:29:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889" returned: 0 in 0.183s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:29:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889" returned: 0 in 0.108s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:27 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6c88a96d-89e1-4b91-a85d-d9b7736b0a26 tempest-SnapshotsActionsTest-1483353926 None] Create snapshot completed successfully Sep 16 22:29:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:29:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:29:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:29:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.222s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:29:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-90716db1-2c68-48f8-a4f4-fd85a2cc2889-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-90716db1-2c68-48f8-a4f4-fd85a2cc2889-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:29 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Acquiring lock "cinder-quobyte-90716db1-2c68-48f8-a4f4-fd85a2cc2889" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-90716db1-2c68-48f8-a4f4-fd85a2cc2889" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Deleting offline snapshot 90716db1-2c68-48f8-a4f4-fd85a2cc2889 of volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:29:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] snapshot_file for this snap is: volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:29:29 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[974516eb-52cb-4180-9f0d-d00719f12aae]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:30 devstack quobyte-client[83246]: System call of process 86000 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:30 devstack quobyte-client[83246]: System call of process 86000 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889" returned: 0 in 0.784s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:30 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5d6b20-91bd-4ee2-a780-aaf4e6e7f27c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:30 devstack quobyte-client[83246]: System call of process 86004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.803s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889" returned: 0 in 0.294s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.90716db1-2c68-48f8-a4f4-fd85a2cc2889" returned: 0 in 0.128s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-90716db1-2c68-48f8-a4f4-fd85a2cc2889" released by "_delete_snapshot" :: held 2.390s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" released by "delete_snapshot" :: held 2.421s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:32 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Created reservations ['54e88c9e-a523-426e-bdd2-39c4289ec112', 'e06b408a-9fea-4b30-8e74-c7d71cd69b3c', 'db8b93aa-b664-4790-9eef-fd246ab9cbc3', '1e1584e4-ec39-43f2-8f82-17ed92536018'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:29:32 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Delete snapshot completed successfully. Sep 16 22:29:32 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6bca8c39-2a51-43ac-9679-93ea65b3b1b3 tempest-SnapshotsActionsTest-1813342145 None] Lock "cinder-90716db1-2c68-48f8-a4f4-fd85a2cc2889-delete_snapshot" released by "delete_snapshot" :: held 2.872s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "cinder-4dc332be-2e70-4900-b0f7-5380b5520e64-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Lock "cinder-4dc332be-2e70-4900-b0f7-5380b5520e64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:33 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "cinder-quobyte-4dc332be-2e70-4900-b0f7-5380b5520e64" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Lock "cinder-quobyte-4dc332be-2e70-4900-b0f7-5380b5520e64" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Deleting offline snapshot 4dc332be-2e70-4900-b0f7-5380b5520e64 of volume 828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] snapshot_file for this snap is: volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ba7fdc-cd50-40cb-91e1-f3f7cdeb3167]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:33 devstack quobyte-client[83246]: System call of process 86012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.470s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828584ba-4dce-4468-a5ba-565e2a69addc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[36158018-b6f3-413c-9f7f-b800ca6b3874]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc" returned: 0 in 0.540s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.240s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc.4dc332be-2e70-4900-b0f7-5380b5520e64" returned: 0 in 0.147s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Lock "cinder-quobyte-4dc332be-2e70-4900-b0f7-5380b5520e64" released by "_delete_snapshot" :: held 1.737s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" released by "delete_snapshot" :: held 1.781s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:35 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Created reservations ['0a9ecfca-93a9-4ac5-b314-274be65e0c5d', '35de2ecc-4c31-4a0e-aea2-321a6ae3ffee', '7aacf840-4f35-468b-93aa-995df2e7ca07', '6aefa0e2-42d0-4a8b-a070-1605bb0dc21b'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:29:35 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Delete snapshot completed successfully. Sep 16 22:29:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8acff368-5a54-47f8-8df5-d7f93b300628 tempest-SnapshotsActionsTest-1483353926 None] Lock "cinder-4dc332be-2e70-4900-b0f7-5380b5520e64-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "cinder-828584ba-4dce-4468-a5ba-565e2a69addc-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Lock "cinder-828584ba-4dce-4468-a5ba-565e2a69addc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:36 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" acquired by "delete_volume" :: waited 0.019s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:36 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce98ce9-1215-430a-af4b-cfc5af3135d0]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc" returned: 0 in 0.544s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-828584ba-4dce-4468-a5ba-565e2a69addc" returned: 0 in 0.118s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Lock "cinder-quobyte-828584ba-4dce-4468-a5ba-565e2a69addc" released by "delete_volume" :: held 0.858s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:38 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Created reservations ['7d62bbb4-b65a-412b-a242-b10944b02070', 'a0fe6537-613a-430b-9070-dd40b0f7099a', 'b81b834f-31eb-4f47-b8b4-103076182797', '3848e57e-7bb3-482a-9bb5-d4aee918d061'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:29:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:29:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:29:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.151s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:38 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:29:38 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Deleted volume successfully. Sep 16 22:29:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7a1d14af-47e5-4c6b-8425-69de57bb3ced tempest-SnapshotsActionsTest-1483353926 None] Lock "cinder-828584ba-4dce-4468-a5ba-565e2a69addc-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:48 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=54,cinder:SELECT=51,cinder:DELETE=4,cinder:INSERT=15 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:29:48 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=34,cinder:UPDATE=48,cinder:DELETE=4,cinder:INSERT=13 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:29:51 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:51 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:29:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Flow 'volume_create_manager' (dafb896b-4606-4628-bbb1-62b8ed08f1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:29:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6aee56-2a7c-4621-8ff1-299e90caf7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6aee56-2a7c-4621-8ff1-299e90caf7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2091139644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06ddca0-4a33-406a-956b-4313c5f452b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30af39331747bb99270e62c042a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:29:51Z,use_quota=True,user_id='1088777af7cc4800ab0e288eac5379ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32dee985-7d59-4e6f-8c88-1d6963598e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32dee985-7d59-4e6f-8c88-1d6963598e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fa52d0-09f7-41d9-a31d-792c85fc8533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fa52d0-09f7-41d9-a31d-792c85fc8533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06ddca0-4a33-406a-956b-4313c5f452b2', 'volume_name': 'volume-d06ddca0-4a33-406a-956b-4313c5f452b2', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daca4cf0-5c25-4b6c-9d7a-bf2f7d6e9daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daca4cf0-5c25-4b6c-9d7a-bf2f7d6e9daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f3e0ee-09e2-4e35-83b5-07597ff41772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:52 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Volume d06ddca0-4a33-406a-956b-4313c5f452b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06ddca0-4a33-406a-956b-4313c5f452b2', 'volume_size': 1} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2091139644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06ddca0-4a33-406a-956b-4313c5f452b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30af39331747bb99270e62c042a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:29:51Z,use_quota=True,user_id='1088777af7cc4800ab0e288eac5379ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Creating volume d06ddca0-4a33-406a-956b-4313c5f452b2 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:29:52 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d06ddca0-4a33-406a-956b-4313c5f452b2 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:52 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=15, name=volume-d06ddca0-4a33-406a-956b-4313c5f452b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d06ddca0-4a33-406a-956b-4313c5f452b2 1073741824" returned: 0 in 0.681s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d06ddca0-4a33-406a-956b-4313c5f452b2 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d06ddca0-4a33-406a-956b-4313c5f452b2" returned: 0 in 0.174s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] <== create_volume: return (1024ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:29:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f3e0ee-09e2-4e35-83b5-07597ff41772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06ddca0-4a33-406a-956b-4313c5f452b2', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa10abb1-494f-496b-a320-18c445e9de48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:53 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Volume volume-d06ddca0-4a33-406a-956b-4313c5f452b2 (d06ddca0-4a33-406a-956b-4313c5f452b2): created successfully Sep 16 22:29:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa10abb1-494f-496b-a320-18c445e9de48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Flow 'volume_create_manager' (dafb896b-4606-4628-bbb1-62b8ed08f1fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:29:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e07201c4-416a-49ef-ba4e-a506f63066b5 tempest-VolumeQuotasAdminTestJSON-167049336 None] Created volume successfully. Sep 16 22:29:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Acquiring lock "cinder-d06ddca0-4a33-406a-956b-4313c5f452b2-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "cinder-d06ddca0-4a33-406a-956b-4313c5f452b2-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:55 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Acquiring lock "cinder-quobyte-d06ddca0-4a33-406a-956b-4313c5f452b2" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:29:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "cinder-quobyte-d06ddca0-4a33-406a-956b-4313c5f452b2" acquired by "delete_volume" :: waited 0.020s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:29:55 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdb7d57-5fd5-43ad-a494-bd37016c8fd2]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:29:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d06ddca0-4a33-406a-956b-4313c5f452b2 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d06ddca0-4a33-406a-956b-4313c5f452b2" returned: 0 in 0.732s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d06ddca0-4a33-406a-956b-4313c5f452b2 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d06ddca0-4a33-406a-956b-4313c5f452b2" returned: 0 in 0.167s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:56 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "cinder-quobyte-d06ddca0-4a33-406a-956b-4313c5f452b2" released by "delete_volume" :: held 1.182s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:57 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Created reservations ['e04ee3d2-cc7d-4f39-b7bc-e7bd23ab78cd', 'f0530eab-8c17-47b2-a230-958cd593b696', 'b23354d9-bede-4763-a742-546a3b25e63e', 'a6066979-08c4-4c3f-833d-e3dffa8a5085'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:29:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:29:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:29:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.160s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:57 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:29:57 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Deleted volume successfully. Sep 16 22:29:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56a0d21a-1c84-4fef-8a17-e33270e461ee tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "cinder-d06ddca0-4a33-406a-956b-4313c5f452b2-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:29:58 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Flow 'volume_create_manager' (76cdd999-aba6-4df1-8449-bc59547d3b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2848f8-8439-471f-b7f9-50a0aa98bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2848f8-8439-471f-b7f9-50a0aa98bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-135739841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30af39331747bb99270e62c042a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:29:58Z,use_quota=True,user_id='1088777af7cc4800ab0e288eac5379ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e951430c-8bbb-4032-9016-206784116377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e951430c-8bbb-4032-9016-206784116377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c03cac3-d7df-4d14-b136-b346a02f7464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c03cac3-d7df-4d14-b136-b346a02f7464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50', 'volume_name': 'volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78908d9-9456-42d8-a4fe-cf49a1515c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78908d9-9456-42d8-a4fe-cf49a1515c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f5c34e-e246-43c0-9437-cd38bc329cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:58 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Volume 1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50', 'volume_size': 1} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-135739841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30af39331747bb99270e62c042a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:29:58Z,use_quota=True,user_id='1088777af7cc4800ab0e288eac5379ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Creating volume 1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:29:58 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:29:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:59 devstack quobyte-client[83246]: System call of process 86069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:29:59 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=16, name=volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:29:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50 1073741824" returned: 0 in 0.435s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:29:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50" returned: 0 in 0.188s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:29:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] <== create_volume: return (711ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:29:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:29:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f5c34e-e246-43c0-9437-cd38bc329cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad800f6d-6d9f-45bb-a41a-6cbbad64e4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:29:59 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Volume volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50 (1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50): created successfully Sep 16 22:29:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad800f6d-6d9f-45bb-a41a-6cbbad64e4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:29:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Flow 'volume_create_manager' (76cdd999-aba6-4df1-8449-bc59547d3b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:30:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c203b18b-4b41-4bfe-8103-028c1618aa3a tempest-VolumeQuotasAdminTestJSON-167049336 None] Created volume successfully. Sep 16 22:30:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-738de15e-531d-45f1-8a39-f1b535b1ee31 tempest-VolumeQuotasAdminTestJSON-84806141 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:30:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-738de15e-531d-45f1-8a39-f1b535b1ee31 tempest-VolumeQuotasAdminTestJSON-84806141 None] Transfer volume completed successfully. Sep 16 22:30:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Acquiring lock "cinder-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:30:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Lock "cinder-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:30:03 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:30:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Acquiring lock "cinder-quobyte-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:30:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Lock "cinder-quobyte-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50" acquired by "delete_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:30:03 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0953bd8-b7c1-4608-afd6-0f68eb6e5c1e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:30:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50" returned: 0 in 0.730s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50" returned: 0 in 0.128s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Lock "cinder-quobyte-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50" released by "delete_volume" :: held 1.154s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:30:04 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Created reservations ['8c47a094-0147-426b-b727-279550786266', '1e490068-2dfd-463e-8242-37566b65f0a1', '11075aca-0f34-433e-98b0-f6b2c0eb40ea', '6f8f6207-aa11-497c-8205-4ce5966dc3c0'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:30:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:30:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:30:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.161s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:05 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:30:05 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Deleted volume successfully. Sep 16 22:30:05 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-352e69eb-ea28-494c-b2fa-bbb478f71199 tempest-VolumeQuotasAdminTestJSON-1274761334 None] Lock "cinder-1fdc4ae0-de7e-428e-ae3a-54a7f5e24b50-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=13,cinder:UPDATE=19,cinder:INSERT=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=12,cinder:UPDATE=21,cinder:DELETE=4,cinder:INSERT=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:30:15 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Flow 'volume_create_manager' (99631332-12a3-4140-9971-0d0a6551cf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595ec65d-d522-481b-9797-35de85394d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595ec65d-d522-481b-9797-35de85394d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-112315126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85d0c44-c817-4c01-9acd-6b055e48098f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51f559653b040d5a3becd69202537b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:30:15Z,use_quota=True,user_id='556ff93759d441c18a7a09a10d00e767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a74052a7-2425-4fd1-bf12-2c93050db3b1),volume_type_id=a74052a7-2425-4fd1-bf12-2c93050db3b1)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce04d73-f77b-42ea-9323-bf100aa1daa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce04d73-f77b-42ea-9323-bf100aa1daa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3adf783-5541-46bf-92a6-1cdba66b4436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3adf783-5541-46bf-92a6-1cdba66b4436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85d0c44-c817-4c01-9acd-6b055e48098f', 'volume_name': 'volume-a85d0c44-c817-4c01-9acd-6b055e48098f', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465d784f-6bb6-40ea-a184-926e50d02ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465d784f-6bb6-40ea-a184-926e50d02ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdcf9a13-49b9-421c-9da9-928ff0fcb1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:15 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Volume a85d0c44-c817-4c01-9acd-6b055e48098f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85d0c44-c817-4c01-9acd-6b055e48098f', 'volume_size': 1} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-112315126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85d0c44-c817-4c01-9acd-6b055e48098f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51f559653b040d5a3becd69202537b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:30:15Z,use_quota=True,user_id='556ff93759d441c18a7a09a10d00e767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a74052a7-2425-4fd1-bf12-2c93050db3b1),volume_type_id=a74052a7-2425-4fd1-bf12-2c93050db3b1)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Creating volume a85d0c44-c817-4c01-9acd-6b055e48098f {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:30:15 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:30:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a85d0c44-c817-4c01-9acd-6b055e48098f 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:15 devstack quobyte-client[83246]: System call of process 86083 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:30:15 devstack quobyte-client[83246]: System call of process 86083 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:30:15 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=17, name=volume-a85d0c44-c817-4c01-9acd-6b055e48098f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:30:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a85d0c44-c817-4c01-9acd-6b055e48098f 1073741824" returned: 0 in 0.356s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a85d0c44-c817-4c01-9acd-6b055e48098f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a85d0c44-c817-4c01-9acd-6b055e48098f" returned: 0 in 0.156s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] <== create_volume: return (585ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:30:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.597s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdcf9a13-49b9-421c-9da9-928ff0fcb1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85d0c44-c817-4c01-9acd-6b055e48098f', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0cc2d24-7772-4aa5-b790-429a2a8666f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:16 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Volume volume-a85d0c44-c817-4c01-9acd-6b055e48098f (a85d0c44-c817-4c01-9acd-6b055e48098f): created successfully Sep 16 22:30:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0cc2d24-7772-4aa5-b790-429a2a8666f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Flow 'volume_create_manager' (99631332-12a3-4140-9971-0d0a6551cf87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:30:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-f2c128e7-d060-413d-84f4-8a78fb79ff64 tempest-VolumeTypesAccessTest-1716231850 None] Created volume successfully. Sep 16 22:30:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Acquiring lock "cinder-a85d0c44-c817-4c01-9acd-6b055e48098f-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:30:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Lock "cinder-a85d0c44-c817-4c01-9acd-6b055e48098f-delete_volume" acquired by "delete_volume" :: waited 0.173s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:30:19 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:30:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Acquiring lock "cinder-quobyte-a85d0c44-c817-4c01-9acd-6b055e48098f" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:30:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Lock "cinder-quobyte-a85d0c44-c817-4c01-9acd-6b055e48098f" acquired by "delete_volume" :: waited 0.020s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:30:19 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[310279c6-d576-4771-8c20-9132b43d2664]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:30:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a85d0c44-c817-4c01-9acd-6b055e48098f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a85d0c44-c817-4c01-9acd-6b055e48098f" returned: 0 in 0.656s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a85d0c44-c817-4c01-9acd-6b055e48098f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a85d0c44-c817-4c01-9acd-6b055e48098f" returned: 0 in 0.202s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:20 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Lock "cinder-quobyte-a85d0c44-c817-4c01-9acd-6b055e48098f" released by "delete_volume" :: held 1.137s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:30:20 devstack cinder-volume[83223]: WARNING cinder.quota [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1389118427 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1389118427, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:30:20 devstack cinder-volume[83223]: WARNING cinder.quota [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1389118427 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1389118427, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:30:20 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Created reservations ['e0a4d81d-bd15-40ed-b412-1425def82b81', '958e55a5-1e71-4257-90c9-03a01d049e4a', '2cc340e5-31e7-487c-8f84-44ebaa1c1580', 'c52d7860-c439-4258-bb62-798c480ef17d'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:30:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:30:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:30:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.284s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:21 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:30:21 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Deleted volume successfully. Sep 16 22:30:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fe72d001-4f1a-4d90-b07c-d747ad73165e tempest-VolumeTypesAccessTest-1716231850 None] Lock "cinder-a85d0c44-c817-4c01-9acd-6b055e48098f-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:30:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:30:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:30:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:30:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.155s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:30:31 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Flow 'volume_create_manager' (a40129ed-f8d1-403b-9e0f-0ef0f7e02969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c863cc08-72ce-4519-9b91-e1d0c838ebd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c863cc08-72ce-4519-9b91-e1d0c838ebd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1609458594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ae99db-43cf-4bc1-a14b-2dcd0c39023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4ca26b6be4cf1a435a95201fa1256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:30:31Z,use_quota=True,user_id='eb4838eb7fa54a7aa36498ad11fd1bcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54c3a09-88d7-4f50-944e-2275e0afff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54c3a09-88d7-4f50-944e-2275e0afff18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533a6dbf-7ec5-4ac2-8dc6-2ec1bf7a1cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533a6dbf-7ec5-4ac2-8dc6-2ec1bf7a1cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ae99db-43cf-4bc1-a14b-2dcd0c39023e', 'volume_name': 'volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdbd26c-4ca8-4d31-9654-56baa7e89b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdbd26c-4ca8-4d31-9654-56baa7e89b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c651be69-504e-46f7-bf84-496a98c2d284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:31 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Volume 30ae99db-43cf-4bc1-a14b-2dcd0c39023e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e', 'volume_size': 1} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1609458594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ae99db-43cf-4bc1-a14b-2dcd0c39023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4ca26b6be4cf1a435a95201fa1256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:30:31Z,use_quota=True,user_id='eb4838eb7fa54a7aa36498ad11fd1bcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Creating volume 30ae99db-43cf-4bc1-a14b-2dcd0c39023e {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:30:31 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:30:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:31 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=18, name=volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:30:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e 1073741824" returned: 0 in 0.537s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" returned: 0 in 0.144s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] <== create_volume: return (765ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:30:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c651be69-504e-46f7-bf84-496a98c2d284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990fe064-d451-4b63-a3fe-5d34084dff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:32 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Volume volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e (30ae99db-43cf-4bc1-a14b-2dcd0c39023e): created successfully Sep 16 22:30:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990fe064-d451-4b63-a3fe-5d34084dff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Flow 'volume_create_manager' (a40129ed-f8d1-403b-9e0f-0ef0f7e02969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:30:32 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7d6993ec-ff3e-4880-83d5-a5bf0dbe5587 tempest-SnapshotMetadataTestJSON-1797723845 None] Created volume successfully. Sep 16 22:30:34 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:30:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Creating offline snapshot 190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 of volume 30ae99db-43cf-4bc1-a14b-2dcd0c39023e {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:30:34 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4613f77a-d7e3-461d-b75d-4553d54c3b32]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:30:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" returned: 0 in 0.610s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:34 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=19, name=volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 1G" returned: 0 in 0.319s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): qemu-img rebase -u -b volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:35 devstack quobyte-client[83246]: System call of process 86143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "qemu-img rebase -u -b volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0" returned: 0 in 0.170s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0" returned: 0 in 0.147s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0" returned: 0 in 0.147s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.info" returned: 0 in 0.115s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.info" returned: 0 in 0.111s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:36 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a3e1813f-7b7c-4faf-ab00-5e2d55cfce36 tempest-SnapshotMetadataTestJSON-1797723845 None] Create snapshot completed successfully Sep 16 22:30:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Acquiring lock "cinder-190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:30:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "cinder-190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:30:38 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:30:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Acquiring lock "cinder-quobyte-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:30:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "cinder-quobyte-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:30:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Acquiring lock "cinder-quobyte-190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:30:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "cinder-quobyte-190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:30:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Deleting offline snapshot 190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 of volume 30ae99db-43cf-4bc1-a14b-2dcd0c39023e {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:30:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] snapshot_file for this snap is: volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:30:38 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[617a1c9e-0c48-4446-a0ce-1a41a84206c9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:30:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0" returned: 0 in 0.727s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:30:39 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9499d02-fae2-4751-81bb-b8ebcefaf6b1]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:30:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" returned: 0 in 0.803s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:40 devstack quobyte-client[83246]: System call of process 86172 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:30:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0" returned: 0 in 0.336s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e.190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0" returned: 0 in 0.211s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "cinder-quobyte-190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0" released by "_delete_snapshot" :: held 2.520s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:30:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "cinder-quobyte-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" released by "delete_snapshot" :: held 2.546s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:30:41 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Created reservations ['09666f87-1291-4a65-a3e1-9fd8b20d27a9', 'a356134c-4d89-4a95-aed8-d4d0a14d94ac', '9907da4c-ba25-4b04-b07c-58b23b91e9e2', 'f65ac81c-b001-4745-a50e-ee3b014fc95b'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:30:41 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Delete snapshot completed successfully. Sep 16 22:30:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a855f05c-a563-46f0-8436-1fa349b50b24 tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "cinder-190ec4c7-3c07-4dc8-ae3b-4ebbf2936da0-delete_snapshot" released by "delete_snapshot" :: held 3.098s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:30:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Acquiring lock "cinder-30ae99db-43cf-4bc1-a14b-2dcd0c39023e-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:30:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "cinder-30ae99db-43cf-4bc1-a14b-2dcd0c39023e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:30:41 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:30:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Acquiring lock "cinder-quobyte-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:30:42 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "cinder-quobyte-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:30:42 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16f4b36-460e-46d5-af8d-34173406cb3e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:30:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" returned: 0 in 0.585s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" returned: 0 in 0.123s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "cinder-quobyte-30ae99db-43cf-4bc1-a14b-2dcd0c39023e" released by "delete_volume" :: held 1.003s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:30:43 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Created reservations ['f610dae4-f5fa-4ea7-b351-520f93e2ee49', '34deda15-bd40-49c2-826f-78b613ef24fe', 'dc72a51f-33a7-4c67-974e-9944a6ed3bfb', 'dab64ce8-e9ce-4f1c-897e-d84df21bae93'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:30:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:30:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:30:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.127s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:43 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:30:44 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Deleted volume successfully. Sep 16 22:30:45 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-806aef46-51b4-4d11-ad65-427b2b1aee3e tempest-SnapshotMetadataTestJSON-1797723845 None] Lock "cinder-30ae99db-43cf-4bc1-a14b-2dcd0c39023e-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:30:53 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=16,cinder:SELECT=11,cinder:DELETE=1,cinder:INSERT=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:30:54 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=20,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:30:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:30:57 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Flow 'volume_create_manager' (d4ed0b7c-7716-48d6-afc2-a26e3277053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2848938d-6b61-44f1-a24a-ac42d2af1dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2848938d-6b61-44f1-a24a-ac42d2af1dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-458618833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fdddb4-1900-4048-84f7-1d29c2b4e9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb136c408a6643d0a4cc35e96e35ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:30:58Z,use_quota=True,user_id='111435059ee746a7bfeedc9cca98ad9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913f67cc-04df-406f-9cf0-7a84c0007734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913f67cc-04df-406f-9cf0-7a84c0007734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1989a8-c56d-4965-a183-23464a8f0a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1989a8-c56d-4965-a183-23464a8f0a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1fdddb4-1900-4048-84f7-1d29c2b4e9ad', 'volume_name': 'volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef0d604-0db2-4bed-9d82-3bd37ca116d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef0d604-0db2-4bed-9d82-3bd37ca116d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b16150-56b6-4721-a85c-6db0b7532a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:58 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Volume d1fdddb4-1900-4048-84f7-1d29c2b4e9ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad', 'volume_size': 1} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-458618833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fdddb4-1900-4048-84f7-1d29c2b4e9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb136c408a6643d0a4cc35e96e35ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:30:58Z,use_quota=True,user_id='111435059ee746a7bfeedc9cca98ad9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Creating volume d1fdddb4-1900-4048-84f7-1d29c2b4e9ad {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:30:58 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:58 devstack quobyte-client[83246]: System call of process 86535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:30:58 devstack quobyte-client[83246]: System call of process 86535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:30:58 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=21, name=volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad 1073741824" returned: 0 in 0.461s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:30:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" returned: 0 in 0.220s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:30:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] <== create_volume: return (832ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:30:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:30:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b16150-56b6-4721-a85c-6db0b7532a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eae0b03-bccf-4023-b10d-81d67bf1176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:30:59 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Volume volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad (d1fdddb4-1900-4048-84f7-1d29c2b4e9ad): created successfully Sep 16 22:30:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eae0b03-bccf-4023-b10d-81d67bf1176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:30:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Flow 'volume_create_manager' (d4ed0b7c-7716-48d6-afc2-a26e3277053d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:30:59 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6c9de09f-864e-4c26-83d9-a7854623d834 tempest-VolumesDeleteCascade-386584103 None] Created volume successfully. Sep 16 22:31:00 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Creating offline snapshot ddc1d8b3-3d0f-441a-8089-f912719415a6 of volume d1fdddb4-1900-4048-84f7-1d29c2b4e9ad {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:31:00 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[460f06e2-dbe1-4f0d-978d-31368dbd4ce5]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:00 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-7a85fcff-07eb-4546-9f3a-5caf098d63a7 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-7a85fcff-07eb-4546-9f3a-5caf098d63a7 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-7a85fcff-07eb-4546-9f3a-5caf098d63a7 tempest-TaggedBootDevicesTest-1268064050 None] Terminate volume connection completed successfully. Sep 16 22:31:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-7a85fcff-07eb-4546-9f3a-5caf098d63a7 tempest-TaggedBootDevicesTest-1268064050 None] Deleting attachment a61d13fe-52de-48c3-a2ae-922e72ccf84e. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:31:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" returned: 0 in 0.558s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:01 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=22, name=volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:31:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 1G" returned: 0 in 0.227s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:01 devstack quobyte-client[83246]: System call of process 86549 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:31:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-9c04fe71-fe60-448a-be97-a9f3c1972f3b tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img rebase -u -b volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6" returned: 0 in 0.403s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:31:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-9c04fe71-fe60-448a-be97-a9f3c1972f3b tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:02 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-9c04fe71-fe60-448a-be97-a9f3c1972f3b tempest-TaggedBootDevicesTest-1268064050 None] Terminate volume connection completed successfully. Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-9c04fe71-fe60-448a-be97-a9f3c1972f3b tempest-TaggedBootDevicesTest-1268064050 None] Deleting attachment c1ee6737-36ff-47cc-ac7a-56f10c9c43d3. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6" returned: 0 in 0.180s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6" returned: 0 in 0.131s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.info" returned: 0 in 0.132s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-4bcd14b2-1200-4eb7-aab2-0c31f82a89b2 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.info" returned: 0 in 0.315s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-4bcd14b2-1200-4eb7-aab2-0c31f82a89b2 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:02 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-4bcd14b2-1200-4eb7-aab2-0c31f82a89b2 tempest-TaggedBootDevicesTest-1268064050 None] Terminate volume connection completed successfully. Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-2985a9b8-66e8-43dd-82a1-5bb17a8ba158 req-4bcd14b2-1200-4eb7-aab2-0c31f82a89b2 tempest-TaggedBootDevicesTest-1268064050 None] Deleting attachment 9c12fbbd-32a1-423a-bf2c-7bef8c46d111. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:31:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.211s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:03 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-26d64e8a-cf38-45ac-b352-7c456d5ecf80 tempest-VolumesDeleteCascade-386584103 None] Create snapshot completed successfully Sep 16 22:31:04 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Creating offline snapshot 83151288-7dd9-4077-91c4-242b1ee50cbe of volume d1fdddb4-1900-4048-84f7-1d29c2b4e9ad {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:31:04 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba1d741-01d6-45ee-9e59-83b785796600]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6" returned: 0 in 0.513s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:31:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:05 devstack quobyte-client[83246]: System call of process 86559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:31:05 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=24, name=volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:31:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe 1G" returned: 0 in 0.403s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img rebase -u -b volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe" returned: 0 in 0.207s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:31:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe" returned: 0 in 0.094s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:31:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe" returned: 0 in 0.084s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.674s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:06 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8db794c3-f53c-4234-a2fe-1ea2c881589d tempest-VolumesDeleteCascade-386584103 None] Create snapshot completed successfully Sep 16 22:31:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Performing cascade delete. {{(pid=83223) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-83151288-7dd9-4077-91c4-242b1ee50cbe-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-83151288-7dd9-4077-91c4-242b1ee50cbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:08 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-83151288-7dd9-4077-91c4-242b1ee50cbe" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-83151288-7dd9-4077-91c4-242b1ee50cbe" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Deleting offline snapshot 83151288-7dd9-4077-91c4-242b1ee50cbe of volume d1fdddb4-1900-4048-84f7-1d29c2b4e9ad {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] snapshot_file for this snap is: volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[718f8548-9cc0-4c65-ad30-afd0f08e23f9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:08 devstack quobyte-client[83246]: System call of process 86583 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe" returned: 0 in 0.599s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:31:09 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[76101d9e-911e-4cae-b0df-345e6b49fd04]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6" returned: 0 in 0.709s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:31:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe" returned: 0 in 0.413s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.83151288-7dd9-4077-91c4-242b1ee50cbe" returned: 0 in 0.113s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-83151288-7dd9-4077-91c4-242b1ee50cbe" released by "_delete_snapshot" :: held 2.471s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" released by "delete_snapshot" :: held 2.506s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Created reservations ['22c3ee14-7eff-4c06-9389-ba21a3d63ac2', '00c28d63-33b2-42aa-ab61-32a4886a98a3', '96aeadbe-a4e6-4676-9843-d27b03934f4e', '452abdc2-0060-496e-bbde-72f2b1692b1c'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:31:11 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Delete snapshot completed successfully. Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-83151288-7dd9-4077-91c4-242b1ee50cbe-delete_snapshot" released by "delete_snapshot" :: held 3.257s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-ddc1d8b3-3d0f-441a-8089-f912719415a6-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-ddc1d8b3-3d0f-441a-8089-f912719415a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-ddc1d8b3-3d0f-441a-8089-f912719415a6" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-ddc1d8b3-3d0f-441a-8089-f912719415a6" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Deleting offline snapshot ddc1d8b3-3d0f-441a-8089-f912719415a6 of volume d1fdddb4-1900-4048-84f7-1d29c2b4e9ad {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] snapshot_file for this snap is: volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91279f1-d1da-47f7-ac3b-22b659faa0b6]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6" returned: 0 in 0.570s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:31:12 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e7371a-1086-4c61-a472-eccfd188ced9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" returned: 0 in 0.611s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6" returned: 0 in 0.223s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad.ddc1d8b3-3d0f-441a-8089-f912719415a6" returned: 0 in 0.137s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-ddc1d8b3-3d0f-441a-8089-f912719415a6" released by "_delete_snapshot" :: held 1.868s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" released by "delete_snapshot" :: held 1.892s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "cinder-a10caaac-1b68-4e78-9c02-0cafa950cec6-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-a10caaac-1b68-4e78-9c02-0cafa950cec6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:13 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "cinder-quobyte-a10caaac-1b68-4e78-9c02-0cafa950cec6" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-quobyte-a10caaac-1b68-4e78-9c02-0cafa950cec6" acquired by "delete_volume" :: waited 0.032s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Created reservations ['d0c7513b-397e-4040-8eac-3f05842382e1', '588cb5ce-b550-4ef1-a8ed-b4ed12f9311d', '6af99ef9-a578-4ab0-b45e-c10b81d0ebd7', '838a34ce-8d19-4eb9-8401-2d1f59abaff4'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8205eb96-ee36-49ac-b58f-2ebdae6c8994]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a10caaac-1b68-4e78-9c02-0cafa950cec6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:14 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Delete snapshot completed successfully. Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-ddc1d8b3-3d0f-441a-8089-f912719415a6-delete_snapshot" released by "delete_snapshot" :: held 2.866s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Snapshots deleted, issuing volume delete {{(pid=83223) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" acquired by "delete_volume" :: waited 0.040s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2900edc-a863-4224-b6b1-b82b68fd51f5]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a10caaac-1b68-4e78-9c02-0cafa950cec6" returned: 0 in 0.610s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a10caaac-1b68-4e78-9c02-0cafa950cec6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a10caaac-1b68-4e78-9c02-0cafa950cec6" returned: 0 in 0.148s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-quobyte-a10caaac-1b68-4e78-9c02-0cafa950cec6" released by "delete_volume" :: held 0.946s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" returned: 0 in 0.600s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" returned: 0 in 0.202s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad" released by "delete_volume" :: held 0.942s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:15 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Created reservations ['666940fe-e92e-4750-9e36-123f93142a5f', '613b80b4-df83-4df8-88a4-c2db14e1174f', '93fcb368-0720-448d-a321-964a158fa316', 'a80e84b8-b323-476e-829d-b48882110f18'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:31:15 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Created reservations ['0f01f1fe-3cb5-45a2-b284-98c8ea1868fc', 'fe39da98-4a1c-4056-ab75-25a7b30e2bf8', 'afdfab21-43f3-4f99-b64d-d8d35ba139d3', '6c7c993b-90a3-4801-aebd-d5d6f0dc4c7f'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:31:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "cinder-612f45ce-1267-4043-be33-4880b143b780-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.493s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:31:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Deleted volume successfully. Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-612f45ce-1267-4043-be33-4880b143b780-delete_volume" acquired by "delete_volume" :: waited 0.183s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ff72e187-cd97-473a-8ecd-9ad59a219560 tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-a10caaac-1b68-4e78-9c02-0cafa950cec6-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:16 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "cinder-quobyte-612f45ce-1267-4043-be33-4880b143b780" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.524s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:31:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Deleted volume successfully. Sep 16 22:31:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-quobyte-612f45ce-1267-4043-be33-4880b143b780" acquired by "delete_volume" :: waited 0.100s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b75c78ff-4f9a-4c82-b5d3-c31d79538dca tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-d1fdddb4-1900-4048-84f7-1d29c2b4e9ad-delete_volume" released by "delete_volume" :: held 9.177s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:17 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d941f8a5-951c-4c7c-a338-9ede2c0912df]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-612f45ce-1267-4043-be33-4880b143b780 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-612f45ce-1267-4043-be33-4880b143b780" returned: 0 in 0.509s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-612f45ce-1267-4043-be33-4880b143b780 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-612f45ce-1267-4043-be33-4880b143b780" returned: 0 in 0.300s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-quobyte-612f45ce-1267-4043-be33-4880b143b780" released by "delete_volume" :: held 1.289s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:18 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Flow 'volume_create_manager' (bed466b4-6e64-43a4-8c38-87af36a01dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504e989f-3ebb-4c43-aad4-6528181164b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504e989f-3ebb-4c43-aad4-6528181164b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1664212860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eaf92af-1054-461d-b58d-b6f60a3063fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb136c408a6643d0a4cc35e96e35ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:31:18Z,use_quota=True,user_id='111435059ee746a7bfeedc9cca98ad9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2f15fa-86be-4a7b-8376-a28b8baecd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2f15fa-86be-4a7b-8376-a28b8baecd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ea2a55-ca18-48c9-bf58-7a2ef20939a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ea2a55-ca18-48c9-bf58-7a2ef20939a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eaf92af-1054-461d-b58d-b6f60a3063fd', 'volume_name': 'volume-8eaf92af-1054-461d-b58d-b6f60a3063fd', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462efa25-7c71-4ef4-af08-792877474cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462efa25-7c71-4ef4-af08-792877474cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fdaca90-1355-48b7-8a6c-575cd0aa1d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:18 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Volume 8eaf92af-1054-461d-b58d-b6f60a3063fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eaf92af-1054-461d-b58d-b6f60a3063fd', 'volume_size': 1} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1664212860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eaf92af-1054-461d-b58d-b6f60a3063fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb136c408a6643d0a4cc35e96e35ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:31:18Z,use_quota=True,user_id='111435059ee746a7bfeedc9cca98ad9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Creating volume 8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:31:18 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:31:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:19 devstack quobyte-client[83246]: System call of process 86668 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:31:19 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=25, name=volume-8eaf92af-1054-461d-b58d-b6f60a3063fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:31:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd 1073741824" returned: 0 in 1.628s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:21 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Created reservations ['acbc064c-8cd6-4f8a-8df5-03ec4e78cf0e', 'c65a49e7-6a43-4e17-9e42-a3436b4c7dc2', '159b5884-d438-4ad2-ba27-99d5f7a1a4b8', '02ee46c6-ce0d-4158-b16b-e5ee5b35fb62'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:31:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd" returned: 0 in 0.938s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] <== create_volume: return (2732ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:31:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.750s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fdaca90-1355-48b7-8a6c-575cd0aa1d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eaf92af-1054-461d-b58d-b6f60a3063fd', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d87ae0-648d-4183-a6cc-3f63b818ca27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:21 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Volume volume-8eaf92af-1054-461d-b58d-b6f60a3063fd (8eaf92af-1054-461d-b58d-b6f60a3063fd): created successfully Sep 16 22:31:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d87ae0-648d-4183-a6cc-3f63b818ca27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Flow 'volume_create_manager' (bed466b4-6e64-43a4-8c38-87af36a01dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:31:21 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-18635616-51a6-40ff-8b00-de5555f3a543 tempest-VolumesDeleteCascade-386584103 None] Created volume successfully. Sep 16 22:31:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:22 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:22 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "cinder-594eb2c0-adb4-4620-908f-212a626b05dc-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-594eb2c0-adb4-4620-908f-212a626b05dc-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.516s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:22 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:31:22 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Deleted volume successfully. Sep 16 22:31:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1070f151-7527-4f18-b0e0-1e8276344abe tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-612f45ce-1267-4043-be33-4880b143b780-delete_volume" released by "delete_volume" :: held 6.776s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:23 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "cinder-quobyte-594eb2c0-adb4-4620-908f-212a626b05dc" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-quobyte-594eb2c0-adb4-4620-908f-212a626b05dc" acquired by "delete_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:23 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:23 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d7967-3ed6-4560-9cf0-fb1554f8c09c]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Creating offline snapshot 295c88ee-ee79-4a02-9b58-0ce0a286e35b of volume 8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:31:24 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[73df1eec-69cf-4b4b-8104-f6c16cdf3ebc]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc" returned: 0 in 0.884s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:25 devstack quobyte-client[83246]: System call of process 86749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd" returned: 0 in 1.203s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc" returned: 1 in 0.901s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:25 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=26, name=volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b 1G" returned: 0 in 0.252s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8eaf92af-1054-461d-b58d-b6f60a3063fd -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-594eb2c0-adb4-4620-908f-212a626b05dc" returned: 0 in 0.223s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-quobyte-594eb2c0-adb4-4620-908f-212a626b05dc" released by "delete_volume" :: held 2.503s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img rebase -u -b volume-8eaf92af-1054-461d-b58d-b6f60a3063fd -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b" returned: 0 in 0.314s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:31:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b" returned: 0 in 0.266s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:31:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b" returned: 0 in 0.301s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:26 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Created reservations ['40f051d4-c2c3-4fbc-997d-2463c1597ab3', 'db50f4a4-d1c1-43ea-b071-a6d6e3137903', '0c412dd6-d0f5-4070-bf79-a8c7e7cca5ad', 'b11543fe-444c-415e-b38e-48d510c0638a'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:31:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.info" returned: 0 in 0.283s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:31:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.info" returned: 0 in 0.251s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.649s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:27 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ddf26f6d-a3e1-4242-8188-7a9618b8aa5b tempest-VolumesDeleteCascade-386584103 None] Create snapshot completed successfully Sep 16 22:31:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.187s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:27 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:31:27 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Deleted volume successfully. Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.302s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-48c9d570-05d9-4d6a-bcfc-d233378780b2 tempest-TaggedBootDevicesTest-1268064050 None] Lock "cinder-594eb2c0-adb4-4620-908f-212a626b05dc-delete_volume" released by "delete_volume" :: held 6.003s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:28 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:28 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Flow 'volume_create_manager' (9183a4bd-3ee8-4ad0-ab07-c9dbf972a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af198df-28d4-4d29-ab34-316cc3757944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af198df-28d4-4d29-ab34-316cc3757944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-986477748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8d4e29-98fb-43f8-aee3-59cf15104d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb136c408a6643d0a4cc35e96e35ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=295c88ee-ee79-4a02-9b58-0ce0a286e35b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:31:29Z,use_quota=True,user_id='111435059ee746a7bfeedc9cca98ad9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c77bcc2-2e29-45c7-8cbb-ced9fe1eab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c77bcc2-2e29-45c7-8cbb-ced9fe1eab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf1f955-c72c-4f73-b77a-e04bbb71d293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf1f955-c72c-4f73-b77a-e04bbb71d293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b8d4e29-98fb-43f8-aee3-59cf15104d73', 'volume_name': 'volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73', 'volume_size': 1, 'snapshot_id': '295c88ee-ee79-4a02-9b58-0ce0a286e35b'}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac04fec-8444-4494-8ec7-b5122306fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac04fec-8444-4494-8ec7-b5122306fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e62db7-2289-422a-88e9-b4a4e2ed84ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:29 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Volume 6b8d4e29-98fb-43f8-aee3-59cf15104d73: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73', 'volume_size': 1, 'snapshot_id': '295c88ee-ee79-4a02-9b58-0ce0a286e35b'} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-295c88ee-ee79-4a02-9b58-0ce0a286e35b-6b8d4e29-98fb-43f8-aee3-59cf15104d73" by "_create_volume_from_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-295c88ee-ee79-4a02-9b58-0ce0a286e35b-6b8d4e29-98fb-43f8-aee3-59cf15104d73" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Creating volume 6b8d4e29-98fb-43f8-aee3-59cf15104d73 from snapshot 295c88ee-ee79-4a02-9b58-0ce0a286e35b {{(pid=83223) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-6b8d4e29-98fb-43f8-aee3-59cf15104d73" by "_copy_volume_from_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-6b8d4e29-98fb-43f8-aee3-59cf15104d73" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] snapshot: 295c88ee-ee79-4a02-9b58-0ce0a286e35b, volume: 6b8d4e29-98fb-43f8-aee3-59cf15104d73, {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f5759d-6606-4360-808a-0987fe0bfc84]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b" returned: 0 in 0.614s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eaf92af-1054-461d-b58d-b6f60a3063fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:31:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 16 22:31:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Creating direct copy from snapshot {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 16 22:31:30 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7ce415-4abf-40c0-ae1d-29654bf77c08]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd" returned: 0 in 1.278s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:31 devstack cinder-volume[83223]: DEBUG cinder.utils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73 not found in is_blk_device check {{(pid=83223) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 22:31:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:32 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=28, name=volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:31:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73" returned: 0 in 7.792s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:39 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b713844-f90e-4167-a7a6-f5d90eeabb6c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd" returned: 0 in 0.971s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:40 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd, size 1024.00 MB, duration 7.86 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73 {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 22:31:40 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Converted 1024.00 MB image at 130.29 MB/s Sep 16 22:31:40 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:31:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73" returned: 0 in 0.185s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-6b8d4e29-98fb-43f8-aee3-59cf15104d73" released by "_copy_volume_from_snapshot" :: held 11.491s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-295c88ee-ee79-4a02-9b58-0ce0a286e35b-6b8d4e29-98fb-43f8-aee3-59cf15104d73" released by "_create_volume_from_snapshot" :: held 11.522s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.539s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e62db7-2289-422a-88e9-b4a4e2ed84ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73', 'volume_size': 1, 'snapshot_id': '295c88ee-ee79-4a02-9b58-0ce0a286e35b'}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644c8c90-3624-44f8-93a3-f5096bbd6ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:41 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Volume volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73 (6b8d4e29-98fb-43f8-aee3-59cf15104d73): created successfully Sep 16 22:31:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644c8c90-3624-44f8-93a3-f5096bbd6ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Flow 'volume_create_manager' (9183a4bd-3ee8-4ad0-ab07-c9dbf972a86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:31:41 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e53c8ba6-aa71-4620-bb7d-cfb26b78960f tempest-VolumesDeleteCascade-386584103 None] Created volume successfully. Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-8eaf92af-1054-461d-b58d-b6f60a3063fd-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-8eaf92af-1054-461d-b58d-b6f60a3063fd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:43 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Performing cascade delete. {{(pid=83223) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-295c88ee-ee79-4a02-9b58-0ce0a286e35b-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-295c88ee-ee79-4a02-9b58-0ce0a286e35b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:43 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-8eaf92af-1054-461d-b58d-b6f60a3063fd" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-8eaf92af-1054-461d-b58d-b6f60a3063fd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-295c88ee-ee79-4a02-9b58-0ce0a286e35b" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-295c88ee-ee79-4a02-9b58-0ce0a286e35b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Deleting offline snapshot 295c88ee-ee79-4a02-9b58-0ce0a286e35b of volume 8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] snapshot_file for this snap is: volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca5c4a4-e32d-4f24-98be-00608cd641e3]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b" returned: 0 in 0.813s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eaf92af-1054-461d-b58d-b6f60a3063fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:31:44 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77fa48a-9fbb-49c9-9757-bf0f70b8df4a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd" returned: 0 in 0.483s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:45 devstack quobyte-client[83246]: System call of process 86832 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:31:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b" returned: 0 in 0.277s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd.295c88ee-ee79-4a02-9b58-0ce0a286e35b" returned: 0 in 0.163s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:45 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-295c88ee-ee79-4a02-9b58-0ce0a286e35b" released by "_delete_snapshot" :: held 2.249s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:45 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-8eaf92af-1054-461d-b58d-b6f60a3063fd" released by "delete_snapshot" :: held 2.286s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:46 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Created reservations ['2e1a5be8-9bb6-4095-b48f-7198f24079ea', '1b6275e9-be3a-48c0-aec0-48db3dbe25aa', '3094695e-6dda-4a73-b411-34de37a58a5b', '71c07675-fc2d-4b2a-acb1-cc9c4ae67b97'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:31:46 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Delete snapshot completed successfully. Sep 16 22:31:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-295c88ee-ee79-4a02-9b58-0ce0a286e35b-delete_snapshot" released by "delete_snapshot" :: held 3.099s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Snapshots deleted, issuing volume delete {{(pid=83223) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 22:31:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-8eaf92af-1054-461d-b58d-b6f60a3063fd" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-8eaf92af-1054-461d-b58d-b6f60a3063fd" acquired by "delete_volume" :: waited 0.034s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:46 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d89d42e-dc18-4cfb-a313-a26bd8bb84e4]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd" returned: 0 in 0.585s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eaf92af-1054-461d-b58d-b6f60a3063fd" returned: 0 in 0.143s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-8eaf92af-1054-461d-b58d-b6f60a3063fd" released by "delete_volume" :: held 0.974s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:47 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Created reservations ['ce5ca5a1-e9bc-4a92-9dd6-289717906255', '486bbfc7-3413-47a3-b83f-f10701060d65', 'c35d731f-81d7-44fa-969c-77c4fa40c152', '203bcd19-8531-481d-9764-1f9f07c85042'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:31:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.211s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:48 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:31:48 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Deleted volume successfully. Sep 16 22:31:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8fd55767-df37-4a9d-a01d-92a23390d17c tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-8eaf92af-1054-461d-b58d-b6f60a3063fd-delete_volume" released by "delete_volume" :: held 5.910s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-6b8d4e29-98fb-43f8-aee3-59cf15104d73-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-6b8d4e29-98fb-43f8-aee3-59cf15104d73-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:49 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "cinder-quobyte-6b8d4e29-98fb-43f8-aee3-59cf15104d73" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:31:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-6b8d4e29-98fb-43f8-aee3-59cf15104d73" acquired by "delete_volume" :: waited 0.021s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:31:49 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c6743-6de6-44df-ace4-58031a24cf0e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:31:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:50 devstack quobyte-client[83246]: System call of process 86843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:31:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73" returned: 0 in 0.769s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6b8d4e29-98fb-43f8-aee3-59cf15104d73" returned: 0 in 0.119s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-quobyte-6b8d4e29-98fb-43f8-aee3-59cf15104d73" released by "delete_volume" :: held 1.358s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:51 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Created reservations ['b8e9d268-0cf9-45a9-a358-c5f67c77d8fa', '135ce080-97df-4496-8345-d1995ffd776f', '2827d916-dd17-4d2e-9ab5-b85f444262cc', 'f43ab2f6-2050-4b8f-8d90-a968c84eded7'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:31:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.202s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:52 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:31:52 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Deleted volume successfully. Sep 16 22:31:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fb19b531-8fd6-4b71-873c-edc9120fc260 tempest-VolumesDeleteCascade-386584103 None] Lock "cinder-6b8d4e29-98fb-43f8-aee3-59cf15104d73-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=63,cinder:UPDATE=80,cinder:DELETE=7,cinder:INSERT=15 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=69,cinder:SELECT=55,cinder:DELETE=5,cinder:INSERT=21 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:31:59 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Flow 'volume_create_manager' (1e16540a-6002-45f1-95ea-1f44953e4631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5235cf-7416-4ed4-97f1-462f2f5a942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5235cf-7416-4ed4-97f1-462f2f5a942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1710272883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a761bed-5f2e-456a-ab9a-9a93e03c0a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1b80258acf4f23bfb0442049e61059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:31:59Z,use_quota=True,user_id='50435f2999884e64b70df041a1d030f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613cc8eb-dd3b-46a0-a103-64c9038db0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613cc8eb-dd3b-46a0-a103-64c9038db0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ab4a10-ca18-47c3-84d3-40ae636689a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ab4a10-ca18-47c3-84d3-40ae636689a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a761bed-5f2e-456a-ab9a-9a93e03c0a16', 'volume_name': 'volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bedf275-dfd4-4121-b169-700eaa515fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bedf275-dfd4-4121-b169-700eaa515fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe449314-49d4-4ed1-815e-2894c7c1ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:31:59 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Volume 5a761bed-5f2e-456a-ab9a-9a93e03c0a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16', 'volume_size': 1} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1710272883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a761bed-5f2e-456a-ab9a-9a93e03c0a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1b80258acf4f23bfb0442049e61059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:31:59Z,use_quota=True,user_id='50435f2999884e64b70df041a1d030f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Creating volume 5a761bed-5f2e-456a-ab9a-9a93e03c0a16 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:31:59 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:31:59 devstack quobyte-client[83246]: System call of process 86859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:31:59 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=29, name=volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16 1073741824" returned: 0 in 0.468s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:31:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16" returned: 0 in 0.213s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] <== create_volume: return (760ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:32:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe449314-49d4-4ed1-815e-2894c7c1ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0166c9-87c8-4580-9d6c-749b12fda331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:00 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Volume volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16 (5a761bed-5f2e-456a-ab9a-9a93e03c0a16): created successfully Sep 16 22:32:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0166c9-87c8-4580-9d6c-749b12fda331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Flow 'volume_create_manager' (1e16540a-6002-45f1-95ea-1f44953e4631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:32:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-9723aeb1-829a-4e19-aff8-43cf87863273 tempest-VolumesMetadataTest-1051247596 None] Created volume successfully. Sep 16 22:32:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Acquiring lock "cinder-5a761bed-5f2e-456a-ab9a-9a93e03c0a16-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:32:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Lock "cinder-5a761bed-5f2e-456a-ab9a-9a93e03c0a16-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:32:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Acquiring lock "cinder-quobyte-5a761bed-5f2e-456a-ab9a-9a93e03c0a16" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:32:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Lock "cinder-quobyte-5a761bed-5f2e-456a-ab9a-9a93e03c0a16" acquired by "delete_volume" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:32:02 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f624761b-009c-451e-8320-96ecadb54478]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16" returned: 0 in 0.553s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a761bed-5f2e-456a-ab9a-9a93e03c0a16" returned: 0 in 0.119s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Lock "cinder-quobyte-5a761bed-5f2e-456a-ab9a-9a93e03c0a16" released by "delete_volume" :: held 0.939s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:32:04 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Created reservations ['7bcb12b8-95c5-447e-8cfc-19602cbbdc71', '61c660ca-d5a7-4259-b3ab-f02a3828ca8b', '764922bb-4eef-4861-82aa-5a9af326fcbe', '01e1cfea-afec-4835-8c24-84b485dc6ba1'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:32:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:32:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:32:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.168s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:04 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:32:04 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Deleted volume successfully. Sep 16 22:32:05 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cab1c371-7974-4afe-b068-a5d7385fe4b4 tempest-VolumesMetadataTest-1051247596 None] Lock "cinder-5a761bed-5f2e-456a-ab9a-9a93e03c0a16-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:32:10 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Flow 'volume_create_manager' (0d2efd3e-2b11-468e-ba25-b4b9deeeadfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148585b2-1b8f-4c0a-81df-fc53a42c2af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148585b2-1b8f-4c0a-81df-fc53a42c2af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-422036765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8f33b9-66b4-4158-b9e0-1c7acc5ef312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fb9fbac49847098caac1281145b4ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:32:10Z,use_quota=True,user_id='a32f103826e74dd48ddbda79504414c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd53ecb5-b0c6-418d-bf9b-a806e9d196ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd53ecb5-b0c6-418d-bf9b-a806e9d196ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243563f0-de60-4b04-9674-868537b3df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243563f0-de60-4b04-9674-868537b3df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8f33b9-66b4-4158-b9e0-1c7acc5ef312', 'volume_name': 'volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f984e-0c96-4b85-bf36-7141db191a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f984e-0c96-4b85-bf36-7141db191a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e2da28-cf46-4f87-b6d3-a6e2e13b7456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:10 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Volume fc8f33b9-66b4-4158-b9e0-1c7acc5ef312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312', 'volume_size': 1} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-422036765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8f33b9-66b4-4158-b9e0-1c7acc5ef312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fb9fbac49847098caac1281145b4ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:32:10Z,use_quota=True,user_id='a32f103826e74dd48ddbda79504414c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Creating volume fc8f33b9-66b4-4158-b9e0-1c7acc5ef312 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:32:10 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:10 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=30, name=volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:32:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312 1073741824" returned: 0 in 0.536s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312" returned: 0 in 0.160s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] <== create_volume: return (845ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:32:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e2da28-cf46-4f87-b6d3-a6e2e13b7456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c95ac6a-f23e-4ceb-960d-209608a6365c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:11 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Volume volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312 (fc8f33b9-66b4-4158-b9e0-1c7acc5ef312): created successfully Sep 16 22:32:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c95ac6a-f23e-4ceb-960d-209608a6365c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Flow 'volume_create_manager' (0d2efd3e-2b11-468e-ba25-b4b9deeeadfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:32:11 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c474ce94-af1d-47e5-b533-ceae1af02643 tempest-VolumesTransfersV357Test-853203610 None] Created volume successfully. Sep 16 22:32:13 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-fde7be5d-5951-4a45-8646-c045816efcba tempest-VolumesTransfersV357Test-770296895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:13 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-fde7be5d-5951-4a45-8646-c045816efcba tempest-VolumesTransfersV357Test-770296895 None] Transfer volume completed successfully. Sep 16 22:32:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Acquiring lock "cinder-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:32:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Lock "cinder-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:32:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Acquiring lock "cinder-quobyte-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:32:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Lock "cinder-quobyte-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312" acquired by "delete_volume" :: waited 0.013s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:32:15 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc1cc50-822e-4976-9b11-a6acac1cbb86]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312" returned: 0 in 0.694s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312" returned: 0 in 0.146s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Lock "cinder-quobyte-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312" released by "delete_volume" :: held 1.128s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Created reservations ['451373eb-e6ef-46fd-869b-97d619e04c31', 'f1e32cd4-00fa-4764-a50f-8a4c4b154d39', '9da5db4a-e8e0-4dcb-b14e-c2bcc3edaae6', '66255a85-84ac-4e33-a6d6-20afe7fdc1f8'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.094s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:32:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Deleted volume successfully. Sep 16 22:32:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d13339fb-9c22-4d3d-a585-decf51d03fa5 tempest-VolumesTransfersV357Test-1762850829 None] Lock "cinder-fc8f33b9-66b4-4158-b9e0-1c7acc5ef312-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:32:17 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Flow 'volume_create_manager' (5a636413-0926-419d-ae5e-fb77965eb54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38099b0-0f35-4baa-b9c3-e8d18605a519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38099b0-0f35-4baa-b9c3-e8d18605a519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1721079597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6940b158-d62e-468d-a24d-c222c74646e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fb9fbac49847098caac1281145b4ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:32:17Z,use_quota=True,user_id='a32f103826e74dd48ddbda79504414c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac3c78c-77fc-4cfc-9f51-cae945428590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac3c78c-77fc-4cfc-9f51-cae945428590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19782ae5-d83b-45cf-8d87-a2b5cee656b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19782ae5-d83b-45cf-8d87-a2b5cee656b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6940b158-d62e-468d-a24d-c222c74646e3', 'volume_name': 'volume-6940b158-d62e-468d-a24d-c222c74646e3', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347926bf-0f13-4fd6-a702-1a799b9c3e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347926bf-0f13-4fd6-a702-1a799b9c3e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e04a96-01fe-411f-b350-d38fd7c9abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:17 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Volume 6940b158-d62e-468d-a24d-c222c74646e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6940b158-d62e-468d-a24d-c222c74646e3', 'volume_size': 1} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1721079597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6940b158-d62e-468d-a24d-c222c74646e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fb9fbac49847098caac1281145b4ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:32:17Z,use_quota=True,user_id='a32f103826e74dd48ddbda79504414c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Creating volume 6940b158-d62e-468d-a24d-c222c74646e3 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:32:17 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:32:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6940b158-d62e-468d-a24d-c222c74646e3 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:18 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=31, name=volume-6940b158-d62e-468d-a24d-c222c74646e3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:32:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6940b158-d62e-468d-a24d-c222c74646e3 1073741824" returned: 0 in 0.333s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6940b158-d62e-468d-a24d-c222c74646e3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6940b158-d62e-468d-a24d-c222c74646e3" returned: 0 in 0.089s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] <== create_volume: return (487ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:32:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.503s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e04a96-01fe-411f-b350-d38fd7c9abad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6940b158-d62e-468d-a24d-c222c74646e3', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097b0728-5f0f-401a-99a4-6e0561521906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:18 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Volume volume-6940b158-d62e-468d-a24d-c222c74646e3 (6940b158-d62e-468d-a24d-c222c74646e3): created successfully Sep 16 22:32:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097b0728-5f0f-401a-99a4-6e0561521906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Flow 'volume_create_manager' (5a636413-0926-419d-ae5e-fb77965eb54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:32:18 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3881f822-9d9d-48d6-82cb-02a00517c795 tempest-VolumesTransfersV357Test-853203610 None] Created volume successfully. Sep 16 22:32:20 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Acquiring lock "cinder-6940b158-d62e-468d-a24d-c222c74646e3-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:32:20 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Lock "cinder-6940b158-d62e-468d-a24d-c222c74646e3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:32:20 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:20 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Acquiring lock "cinder-quobyte-6940b158-d62e-468d-a24d-c222c74646e3" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:32:20 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Lock "cinder-quobyte-6940b158-d62e-468d-a24d-c222c74646e3" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:32:20 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bb74da-7aa7-4635-83fa-727cecfe6d6c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6940b158-d62e-468d-a24d-c222c74646e3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6940b158-d62e-468d-a24d-c222c74646e3" returned: 0 in 0.462s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6940b158-d62e-468d-a24d-c222c74646e3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6940b158-d62e-468d-a24d-c222c74646e3" returned: 0 in 0.092s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Lock "cinder-quobyte-6940b158-d62e-468d-a24d-c222c74646e3" released by "delete_volume" :: held 0.716s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Created reservations ['fd333139-3edc-41ad-baf7-ac4f0ff4853c', '972eb520-0987-4f52-ac87-4bfa5eab6cc9', 'e58f21a2-41f8-4749-be30-7257e2f6ff8e', '9fbffe8e-1d10-4a4b-bcdb-dbb80cd0176c'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.103s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:21 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:32:22 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Deleted volume successfully. Sep 16 22:32:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4298aea1-e94c-4eb7-bef5-a5424c8176f7 tempest-VolumesTransfersV357Test-1762850829 None] Lock "cinder-6940b158-d62e-468d-a24d-c222c74646e3-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:32:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:32:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:32:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:32:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.297s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:32:31 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:31 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:32:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Flow 'volume_create_manager' (e78a63c1-cbd5-4484-9f53-eefac34f3572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:32:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401682a9-e7ee-4114-a1e2-dc018457e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401682a9-e7ee-4114-a1e2-dc018457e471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1729841209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba2138a-9d32-4a67-aef8-b3397736e224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cb2be1470f4d5bae38c23cc68cb1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:32:31Z,use_quota=True,user_id='cb52617f57fe4611a438f980ee45c5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd1e264-a4ec-4516-9ead-e4372196e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd1e264-a4ec-4516-9ead-e4372196e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d30659-643a-454d-951b-1adbf89b54f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d30659-643a-454d-951b-1adbf89b54f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fba2138a-9d32-4a67-aef8-b3397736e224', 'volume_name': 'volume-fba2138a-9d32-4a67-aef8-b3397736e224', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fceb6ba3-aed1-42aa-9e99-d9f021728b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fceb6ba3-aed1-42aa-9e99-d9f021728b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbea7f0c-6c94-4e80-b643-207764c1d250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:32 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Volume fba2138a-9d32-4a67-aef8-b3397736e224: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fba2138a-9d32-4a67-aef8-b3397736e224', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 22:32:32 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Cloning fba2138a-9d32-4a67-aef8-b3397736e224 from image 99ab3cef-3584-47a5-9dcc-19749e64ee70 at location (None, None). {{(pid=83223) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}} Sep 16 22:32:32 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=23,cinder:DELETE=5,cinder:SELECT=19,cinder:INSERT=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:32:32 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 22:32:32 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Image download 20.69 MB at 20.69 MB/s Sep 16 22:32:32 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e46dae-b4fb-40c6-812f-4603061832f6]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:33 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD Sep 16 22:32:33 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:32:35 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Sep 16 22:32:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD" returned: 0 in 2.518s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:35 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Temporary image 99ab3cef-3584-47a5-9dcc-19749e64ee70 is fetched for user cb52617f57fe4611a438f980ee45c5b5. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 22:32:35 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[453566e2-9ab7-4bdb-bb96-3ada4261289b]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:36 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD Sep 16 22:32:36 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:32:38 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD" returned: 0 in 2.877s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1729841209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba2138a-9d32-4a67-aef8-b3397736e224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cb2be1470f4d5bae38c23cc68cb1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:32:31Z,use_quota=True,user_id='cb52617f57fe4611a438f980ee45c5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Creating volume fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:32:38 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:32:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:39 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=32, name=volume-fba2138a-9d32-4a67-aef8-b3397736e224, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:32:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 1073741824" returned: 0 in 0.629s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:40 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Flow 'volume_create_manager' (bba67685-8e2c-4544-b735-0d58724c4467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25bf59c-5dba-4ca9-b626-8337bf2346be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224" returned: 0 in 1.155s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] <== create_volume: return (1976ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25bf59c-5dba-4ca9-b626-8337bf2346be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-788274773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1538d833-b729-414e-a538-6a5af2965a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b8676a1c856427184437323012db9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:32:39Z,use_quota=True,user_id='74ffc50b8a6640a1a568a2a4cb77b937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708faa7b-0d3e-4070-87b4-b34695bf3753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708faa7b-0d3e-4070-87b4-b34695bf3753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501cfa6e-1a8d-4053-9628-9cf5012ed24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501cfa6e-1a8d-4053-9628-9cf5012ed24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1538d833-b729-414e-a538-6a5af2965a3b', 'volume_name': 'volume-1538d833-b729-414e-a538-6a5af2965a3b', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43c6114-5320-4703-9248-775462d6a691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43c6114-5320-4703-9248-775462d6a691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c07589-a2c4-4723-8245-3fd223bfd85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:40 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Volume 1538d833-b729-414e-a538-6a5af2965a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1538d833-b729-414e-a538-6a5af2965a3b', 'volume_size': 1} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:40 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-788274773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1538d833-b729-414e-a538-6a5af2965a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b8676a1c856427184437323012db9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:32:39Z,use_quota=True,user_id='74ffc50b8a6640a1a568a2a4cb77b937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:32:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Creating volume 1538d833-b729-414e-a538-6a5af2965a3b {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:32:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:32:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:32:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:32:41 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:32:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1538d833-b729-414e-a538-6a5af2965a3b 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:41 devstack quobyte-client[83246]: System call of process 87045 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:32:41 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=33, name=volume-1538d833-b729-414e-a538-6a5af2965a3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:32:42 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Attempting download of 99ab3cef-3584-47a5-9dcc-19749e64ee70 ((None, None)) to volume fba2138a-9d32-4a67-aef8-b3397736e224. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 22:32:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1538d833-b729-414e-a538-6a5af2965a3b 1073741824" returned: 0 in 1.296s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1538d833-b729-414e-a538-6a5af2965a3b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:42 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[253eb287-9df0-4d83-9314-16227dde5221]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_4juuwgsv {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1538d833-b729-414e-a538-6a5af2965a3b" returned: 0 in 0.585s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] <== create_volume: return (2022ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:32:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c07589-a2c4-4723-8245-3fd223bfd85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1538d833-b729-414e-a538-6a5af2965a3b', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe144a2-7495-428c-b2f2-a3947b83ab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_4juuwgsv" returned: 0 in 0.737s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_4juuwgsv {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:43 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Volume volume-1538d833-b729-414e-a538-6a5af2965a3b (1538d833-b729-414e-a538-6a5af2965a3b): created successfully Sep 16 22:32:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe144a2-7495-428c-b2f2-a3947b83ab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Flow 'volume_create_manager' (bba67685-8e2c-4544-b735-0d58724c4467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:32:44 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-24176e0c-5b6e-4403-8b4f-d38994b08f1a tempest-AttachSCSIVolumeTestJSON-1515928220 None] Created volume successfully. Sep 16 22:32:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_4juuwgsv" returned: 1 in 1.050s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_4juuwgsv' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:32:44 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[991b0022-afb7-4e39-b377-9a8086c88be4]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD" returned: 0 in 0.726s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:45 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] 99ab3cef-3584-47a5-9dcc-19749e64ee70 was qcow2, converting to raw {{(pid=83223) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 22:32:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:45 devstack quobyte-client[83246]: System call of process 87087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:32:45 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=32, name=volume-fba2138a-9d32-4a67-aef8-b3397736e224, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:32:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224" returned: 0 in 1.041s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:46 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_z0w60syndevstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 22:32:46 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Converted 112.00 MB image at 105.44 MB/s Sep 16 22:32:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:46 devstack quobyte-client[83246]: System call of process 87094 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:32:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 1G" returned: 0 in 0.290s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:46 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9641c75-de7c-47fd-8dff-e2c649c2b513]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224" returned: 0 in 0.478s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224" returned: 1 in 0.634s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Downloaded image 99ab3cef-3584-47a5-9dcc-19749e64ee70 ((None, None)) to volume fba2138a-9d32-4a67-aef8-b3397736e224 successfully. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Temporary image 99ab3cef-3584-47a5-9dcc-19749e64ee70 for user cb52617f57fe4611a438f980ee45c5b5 is deleted. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Marking volume fba2138a-9d32-4a67-aef8-b3397736e224 as bootable. {{(pid=83223) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Copying metadata from image 99ab3cef-3584-47a5-9dcc-19749e64ee70 to fba2138a-9d32-4a67-aef8-b3397736e224. {{(pid=83223) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Creating volume glance metadata for volume fba2138a-9d32-4a67-aef8-b3397736e224 backed by image 99ab3cef-3584-47a5-9dcc-19749e64ee70 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83223) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-ffd2abcd-72f0-479a-ad1f-9d6868a225a7 req-5129dd93-ddc6-477a-b69a-cc88ac1a5f00 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-ffd2abcd-72f0-479a-ad1f-9d6868a225a7 req-5129dd93-ddc6-477a-b69a-cc88ac1a5f00 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8d791c-df34-4b23-9515-2fe1ba46d1ad]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-ffd2abcd-72f0-479a-ad1f-9d6868a225a7 req-5129dd93-ddc6-477a-b69a-cc88ac1a5f00 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1538d833-b729-414e-a538-6a5af2965a3b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbea7f0c-6c94-4e80-b643-207764c1d250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba2138a-9d32-4a67-aef8-b3397736e224', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccf6e21-f701-4108-ac18-ee760f221265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:32:49 devstack quobyte-client[83246]: System call of process 87110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:32:49 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Volume volume-fba2138a-9d32-4a67-aef8-b3397736e224 (fba2138a-9d32-4a67-aef8-b3397736e224): created successfully Sep 16 22:32:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccf6e21-f701-4108-ac18-ee760f221265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:32:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Flow 'volume_create_manager' (e78a63c1-cbd5-4484-9f53-eefac34f3572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:32:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-ffd2abcd-72f0-479a-ad1f-9d6868a225a7 req-5129dd93-ddc6-477a-b69a-cc88ac1a5f00 tempest-AttachSCSIVolumeTestJSON-1515928220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1538d833-b729-414e-a538-6a5af2965a3b" returned: 0 in 0.616s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-ffd2abcd-72f0-479a-ad1f-9d6868a225a7 req-5129dd93-ddc6-477a-b69a-cc88ac1a5f00 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.665s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:49 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-03396c27-e5f4-434e-873e-578d2f7ee78e tempest-VolumesExtendTest-229201588 None] Created volume successfully. Sep 16 22:32:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-ffd2abcd-72f0-479a-ad1f-9d6868a225a7 req-5129dd93-ddc6-477a-b69a-cc88ac1a5f00 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-1538d833-b729-414e-a538-6a5af2965a3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '965744cc-ad27-46d2-9a5d-ef508db34540', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:32:49 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-ffd2abcd-72f0-479a-ad1f-9d6868a225a7 req-5129dd93-ddc6-477a-b69a-cc88ac1a5f00 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:49 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-ffd2abcd-72f0-479a-ad1f-9d6868a225a7 req-5129dd93-ddc6-477a-b69a-cc88ac1a5f00 tempest-AttachSCSIVolumeTestJSON-1515928220 None] attachment_update completed successfully. Sep 16 22:32:50 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:50 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71e3e15-2556-4c06-947b-7cdd6231a353]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224" returned: 0 in 0.731s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:52 devstack quobyte-client[83246]: System call of process 87139 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:32:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224" returned: 1 in 1.214s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:32:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 2G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:52 devstack quobyte-client[83246]: System call of process 87210 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:32:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 2G" returned: 0 in 0.418s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.820s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-cac7f9d6-8590-4c9c-959e-803d80fe5c78 tempest-VolumesExtendTest-229201588 None] Extend volume completed successfully. Sep 16 22:32:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Acquiring lock "cinder-fba2138a-9d32-4a67-aef8-b3397736e224-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:32:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Lock "cinder-fba2138a-9d32-4a67-aef8-b3397736e224-delete_volume" acquired by "delete_volume" :: waited 0.230s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:32:55 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:32:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Acquiring lock "cinder-quobyte-fba2138a-9d32-4a67-aef8-b3397736e224" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:32:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Lock "cinder-quobyte-fba2138a-9d32-4a67-aef8-b3397736e224" acquired by "delete_volume" :: waited 0.024s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:32:55 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdfcc9d-105e-42b9-ba71-6fd1cba7afbf]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:32:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:56 devstack quobyte-client[83246]: System call of process 87519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:32:56 devstack quobyte-client[83246]: System call of process 87519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:32:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224" returned: 0 in 0.903s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224" returned: 1 in 0.770s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:32:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fba2138a-9d32-4a67-aef8-b3397736e224" returned: 0 in 0.289s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Lock "cinder-quobyte-fba2138a-9d32-4a67-aef8-b3397736e224" released by "delete_volume" :: held 2.422s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:32:58 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Created reservations ['93756708-3338-4442-a4e4-2955003baa81', 'f949c0fb-af91-4c83-a98c-772f8fadbf98', 'ebb719ed-dea9-4508-8b14-77efcae37fb3', '84bb6792-de25-4a28-9416-3853b62fb879'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:32:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:32:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:32:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:32:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:32:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:32:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:32:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.212s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:32:58 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:32:58 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Deleted volume successfully. Sep 16 22:32:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4f24abbb-3be5-4a86-8965-510586b294c8 tempest-VolumesExtendTest-229201588 None] Lock "cinder-fba2138a-9d32-4a67-aef8-b3397736e224-delete_volume" released by "delete_volume" :: held 4.142s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=37,cinder:UPDATE=51,cinder:INSERT=13,cinder:DELETE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:33:00 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Flow 'volume_create_manager' (d5a79b22-342b-41ba-9e66-1d8bee429b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e15ed08-cc5c-459a-a07b-9f34496da203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e15ed08-cc5c-459a-a07b-9f34496da203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1433865113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cb2be1470f4d5bae38c23cc68cb1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:00Z,use_quota=True,user_id='cb52617f57fe4611a438f980ee45c5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6aa919b-347c-4913-afca-3c2121839020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6aa919b-347c-4913-afca-3c2121839020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2088479d-645f-407d-a1a3-a000595e0ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2088479d-645f-407d-a1a3-a000595e0ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf', 'volume_name': 'volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9047cc71-15ea-43e7-867c-811fa58a7801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9047cc71-15ea-43e7-867c-811fa58a7801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabf0aea-66be-42b2-ad0e-3794e74907b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:00 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Volume b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf', 'volume_size': 1} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1433865113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cb2be1470f4d5bae38c23cc68cb1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:00Z,use_quota=True,user_id='cb52617f57fe4611a438f980ee45c5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Creating volume b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:33:00 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:33:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:00 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=34, name=volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:33:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf 1073741824" returned: 0 in 0.629s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" returned: 0 in 0.233s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] <== create_volume: return (990ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:33:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabf0aea-66be-42b2-ad0e-3794e74907b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d5dc7a-cdef-4bbc-9924-f64dfb98d675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:01 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Volume volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf (b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf): created successfully Sep 16 22:33:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d5dc7a-cdef-4bbc-9924-f64dfb98d675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Flow 'volume_create_manager' (d5a79b22-342b-41ba-9e66-1d8bee429b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5fdb5c08-cb36-4d85-b5f2-51c66ca229e3 tempest-VolumesExtendTest-229201588 None] Created volume successfully. Sep 16 22:33:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Creating offline snapshot ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 of volume b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:33:02 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4092840a-38a1-4543-9c39-f9281aad2ffb]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" returned: 0 in 0.468s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:03 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=35, name=volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 1G" returned: 0 in 0.251s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] CMD "qemu-img rebase -u -b volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19" returned: 0 in 0.153s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19" returned: 0 in 0.088s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19" returned: 0 in 0.118s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.info" returned: 0 in 0.097s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:33:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.info" returned: 0 in 0.087s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.614s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:04 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-486e5319-b4d6-428d-8533-fed82d1029d2 tempest-VolumesExtendTest-229201588 None] Create snapshot completed successfully Sep 16 22:33:04 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-28d744f1-4b3d-4f5c-a6aa-14649fc7fcd5 tempest-VolumesExtendTest-229201588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-28d744f1-4b3d-4f5c-a6aa-14649fc7fcd5 tempest-VolumesExtendTest-229201588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-28d744f1-4b3d-4f5c-a6aa-14649fc7fcd5 tempest-VolumesExtendTest-229201588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:04 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[12af8806-4cc8-4ed3-8b30-559d8243bbeb]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-28d744f1-4b3d-4f5c-a6aa-14649fc7fcd5 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-28d744f1-4b3d-4f5c-a6aa-14649fc7fcd5 tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" returned: 0 in 0.439s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-28d744f1-4b3d-4f5c-a6aa-14649fc7fcd5 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 2G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-28d744f1-4b3d-4f5c-a6aa-14649fc7fcd5 tempest-VolumesExtendTest-229201588 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 2G" returned: 0 in 0.209s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-28d744f1-4b3d-4f5c-a6aa-14649fc7fcd5 tempest-VolumesExtendTest-229201588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.764s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:05 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-28d744f1-4b3d-4f5c-a6aa-14649fc7fcd5 tempest-VolumesExtendTest-229201588 None] Extend volume completed successfully. Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Acquiring lock "cinder-ce8ffd1c-77b4-4b72-8f9d-084d027f7b19-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Lock "cinder-ce8ffd1c-77b4-4b72-8f9d-084d027f7b19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Acquiring lock "cinder-quobyte-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Lock "cinder-quobyte-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Acquiring lock "cinder-quobyte-ce8ffd1c-77b4-4b72-8f9d-084d027f7b19" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Lock "cinder-quobyte-ce8ffd1c-77b4-4b72-8f9d-084d027f7b19" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Deleting offline snapshot ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 of volume b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] snapshot_file for this snap is: volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e37be5a-7748-4040-9fe0-ec3794b0efb9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19" returned: 0 in 0.433s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8919de-75a6-4ff3-9d22-7c8e48b1d7e9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" returned: 0 in 0.430s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19" returned: 0 in 0.319s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf.ce8ffd1c-77b4-4b72-8f9d-084d027f7b19" returned: 0 in 0.100s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Lock "cinder-quobyte-ce8ffd1c-77b4-4b72-8f9d-084d027f7b19" released by "_delete_snapshot" :: held 1.645s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Lock "cinder-quobyte-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" released by "delete_snapshot" :: held 1.668s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:09 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Created reservations ['aa15ce86-27f4-486a-a423-b66e67e110c8', '30be17ad-f841-476b-a146-1044194dd58b', '26dc6679-5787-4be4-8096-dbac0b26b1ee', 'd547ebaf-dced-4e54-acea-6e88cec76fdc'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:33:09 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Delete snapshot completed successfully. Sep 16 22:33:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2434cdf3-a147-4e90-b7e8-089619900f22 tempest-VolumesExtendTest-229201588 None] Lock "cinder-ce8ffd1c-77b4-4b72-8f9d-084d027f7b19-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Acquiring lock "cinder-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Lock "cinder-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:10 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Acquiring lock "cinder-quobyte-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Lock "cinder-quobyte-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" acquired by "delete_volume" :: waited 0.016s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:10 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3ccd22-4a8a-44f2-b47a-052ba02af647]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" returned: 0 in 0.476s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" returned: 0 in 0.114s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Lock "cinder-quobyte-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf" released by "delete_volume" :: held 0.751s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Created reservations ['9defdc20-0db6-40fd-b128-c1bf87a63e59', '73fdad7e-1d5f-4621-9410-c7158566f475', 'fbe23749-3086-4232-81e4-a8dfe3676ddf', '3e8d0b98-9dd9-49f9-9f1c-44fa8bd13d17'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.120s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:11 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:33:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Deleted volume successfully. Sep 16 22:33:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-260e29e0-49c4-4b75-8265-113c64e096de tempest-VolumesExtendTest-229201588 None] Lock "cinder-b911d1c6-28ca-4c43-bd7c-f2bd8633b2cf-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:18 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Flow 'volume_create_manager' (577a312c-9274-4413-a1c7-f8372b904e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8242124d-e649-417b-bfac-4d26ac9677b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8242124d-e649-417b-bfac-4d26ac9677b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2082940375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3f3cee-55cf-4b23-9105-ed2e74c60a08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e55956c0db7642978a3698f1d889fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:18Z,use_quota=True,user_id='06563e7cf3304e3dbbb15ed0e97ac83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54680c9c-ad2b-4212-9147-3cb8ecf6e9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54680c9c-ad2b-4212-9147-3cb8ecf6e9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b1251b-e97e-4018-ae9f-ac638055af8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b1251b-e97e-4018-ae9f-ac638055af8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3f3cee-55cf-4b23-9105-ed2e74c60a08', 'volume_name': 'volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f533696-7ac0-4c71-a9e1-d2f952e5715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f533696-7ac0-4c71-a9e1-d2f952e5715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b75570f-f3f1-4e78-899f-3476edc7b5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:18 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Volume dc3f3cee-55cf-4b23-9105-ed2e74c60a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08', 'volume_size': 1} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2082940375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3f3cee-55cf-4b23-9105-ed2e74c60a08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e55956c0db7642978a3698f1d889fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:18Z,use_quota=True,user_id='06563e7cf3304e3dbbb15ed0e97ac83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Creating volume dc3f3cee-55cf-4b23-9105-ed2e74c60a08 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:33:18 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:33:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:18 devstack quobyte-client[83246]: System call of process 87624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:33:18 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=37, name=volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:33:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08 1073741824" returned: 0 in 0.336s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08" returned: 0 in 0.080s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] <== create_volume: return (478ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:33:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.492s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b75570f-f3f1-4e78-899f-3476edc7b5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c5e3d0-cd45-4aa5-84de-84fa7ca4d84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:19 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Volume volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08 (dc3f3cee-55cf-4b23-9105-ed2e74c60a08): created successfully Sep 16 22:33:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c5e3d0-cd45-4aa5-84de-84fa7ca4d84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Flow 'volume_create_manager' (577a312c-9274-4413-a1c7-f8372b904e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:19 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b284fe73-06f3-44f1-8b13-f4ae086e96c0 tempest-VolumesListTestJSON-1293960291 None] Created volume successfully. Sep 16 22:33:21 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Flow 'volume_create_manager' (1037eb9c-182c-450f-89dd-13897610ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c3d3d8-e4ac-4aee-b554-42553c84ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c3d3d8-e4ac-4aee-b554-42553c84ea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-95153772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140fa79a-706e-4b3b-82b1-c8ef20f2a523,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e55956c0db7642978a3698f1d889fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:21Z,use_quota=True,user_id='06563e7cf3304e3dbbb15ed0e97ac83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27aceee0-5180-4d38-a2fe-ecd8963f1898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27aceee0-5180-4d38-a2fe-ecd8963f1898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a045c8d8-504f-4531-9aa8-7b3e06bc66a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a045c8d8-504f-4531-9aa8-7b3e06bc66a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '140fa79a-706e-4b3b-82b1-c8ef20f2a523', 'volume_name': 'volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265d7e69-11fc-46bd-9d94-bdaa710876c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265d7e69-11fc-46bd-9d94-bdaa710876c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d322172-a139-4f3f-9b63-ab605b87af46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:21 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Volume 140fa79a-706e-4b3b-82b1-c8ef20f2a523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523', 'volume_size': 1} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-95153772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140fa79a-706e-4b3b-82b1-c8ef20f2a523,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e55956c0db7642978a3698f1d889fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:21Z,use_quota=True,user_id='06563e7cf3304e3dbbb15ed0e97ac83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Creating volume 140fa79a-706e-4b3b-82b1-c8ef20f2a523 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:33:21 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:21 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=38, name=volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523 1073741824" returned: 0 in 0.329s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523" returned: 0 in 0.152s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] <== create_volume: return (601ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:33:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.617s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:22 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-f4141a49-c542-474e-a591-923d7200d9e6 req-9ed79a0c-1885-45fb-881e-920328aa0243 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d322172-a139-4f3f-9b63-ab605b87af46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44e528b-78a9-40fa-a8b1-376c276f460b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:22 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-f4141a49-c542-474e-a591-923d7200d9e6 req-9ed79a0c-1885-45fb-881e-920328aa0243 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:22 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-f4141a49-c542-474e-a591-923d7200d9e6 req-9ed79a0c-1885-45fb-881e-920328aa0243 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Terminate volume connection completed successfully. Sep 16 22:33:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-f4141a49-c542-474e-a591-923d7200d9e6 req-9ed79a0c-1885-45fb-881e-920328aa0243 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Deleting attachment 965744cc-ad27-46d2-9a5d-ef508db34540. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:33:22 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Volume volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523 (140fa79a-706e-4b3b-82b1-c8ef20f2a523): created successfully Sep 16 22:33:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44e528b-78a9-40fa-a8b1-376c276f460b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Flow 'volume_create_manager' (1037eb9c-182c-450f-89dd-13897610ea90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:22 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5cf9c031-30d5-476a-aad2-94a8524d5b04 tempest-VolumesListTestJSON-1293960291 None] Created volume successfully. Sep 16 22:33:24 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Flow 'volume_create_manager' (fa029e9f-0281-48c1-973d-40ffdf88e00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5f4c8e-7d60-4f2c-82c4-360a175e0ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5f4c8e-7d60-4f2c-82c4-360a175e0ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-157055575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1df4ba-366b-46bc-9a6d-e027cc5bca6e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e55956c0db7642978a3698f1d889fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:24Z,use_quota=True,user_id='06563e7cf3304e3dbbb15ed0e97ac83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04cf250-c52f-48da-85f4-83c253fe60b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04cf250-c52f-48da-85f4-83c253fe60b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a39360a-6ca3-4d5a-9099-5924700eb116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a39360a-6ca3-4d5a-9099-5924700eb116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1df4ba-366b-46bc-9a6d-e027cc5bca6e', 'volume_name': 'volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee48e0e-bb0e-4e48-b122-eb43754310d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee48e0e-bb0e-4e48-b122-eb43754310d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a42e36d-67bd-47ff-a597-b3f8c7857d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:24 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Volume 4a1df4ba-366b-46bc-9a6d-e027cc5bca6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e', 'volume_size': 1} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-157055575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1df4ba-366b-46bc-9a6d-e027cc5bca6e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e55956c0db7642978a3698f1d889fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:24Z,use_quota=True,user_id='06563e7cf3304e3dbbb15ed0e97ac83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Creating volume 4a1df4ba-366b-46bc-9a6d-e027cc5bca6e {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:33:24 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:24 devstack quobyte-client[83246]: System call of process 87667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:33:24 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=39, name=volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e 1073741824" returned: 0 in 0.430s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e" returned: 0 in 0.113s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] <== create_volume: return (641ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:33:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:25 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a42e36d-67bd-47ff-a597-b3f8c7857d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:25 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e74647d-f99f-428f-b103-dc706bbe3dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:25 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Volume volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e (4a1df4ba-366b-46bc-9a6d-e027cc5bca6e): created successfully Sep 16 22:33:25 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e74647d-f99f-428f-b103-dc706bbe3dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:25 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Flow 'volume_create_manager' (fa029e9f-0281-48c1-973d-40ffdf88e00f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:25 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-1ac3f7ab-d35e-42e7-b5a3-8cd6553d66e5 tempest-VolumesListTestJSON-1293960291 None] Created volume successfully. Sep 16 22:33:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:33:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.154s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:33:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "cinder-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e-delete_volume" acquired by "delete_volume" :: waited 0.354s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:31 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "cinder-quobyte-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-quobyte-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:31 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e476cc-68b7-4cd0-84d5-41a12f2a5c19]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e" returned: 0 in 0.440s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e" returned: 0 in 0.154s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-quobyte-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e" released by "delete_volume" :: held 0.680s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Created reservations ['19f7bc47-5d9c-47c1-a50c-044ebc9b974a', '33beb645-82ee-4c3f-9cdf-2d6ebd5dc472', '83116481-94b2-4142-93b0-f5948a090660', '4462d08d-145d-4179-949b-5c501ceea5fa'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=46,cinder:UPDATE=59,cinder:DELETE=4,cinder:INSERT=18 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.122s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:32 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:33:32 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Deleted volume successfully. Sep 16 22:33:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9d1c32e-7cd3-47fd-9612-4e8f9d69e0e6 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-4a1df4ba-366b-46bc-9a6d-e027cc5bca6e-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "cinder-140fa79a-706e-4b3b-82b1-c8ef20f2a523-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-140fa79a-706e-4b3b-82b1-c8ef20f2a523-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:33 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "cinder-quobyte-140fa79a-706e-4b3b-82b1-c8ef20f2a523" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-quobyte-140fa79a-706e-4b3b-82b1-c8ef20f2a523" acquired by "delete_volume" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:33 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a200a13-8196-4740-a034-0fefddc194f6]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523" returned: 0 in 0.415s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-140fa79a-706e-4b3b-82b1-c8ef20f2a523" returned: 0 in 0.128s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-quobyte-140fa79a-706e-4b3b-82b1-c8ef20f2a523" released by "delete_volume" :: held 0.721s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Created reservations ['6ada0cc7-5660-497b-bcdc-600362fedbc9', '99af40e8-10f9-4cbe-aca6-45077c028b16', '372471ab-041d-442d-a1b9-03e574466ffc', '8e59d591-e4ec-4cc2-bd39-5d7b99e193e9'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.169s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:35 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:33:35 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Deleted volume successfully. Sep 16 22:33:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a5687b7d-9b27-4e4a-85ce-880b73b6eb50 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-140fa79a-706e-4b3b-82b1-c8ef20f2a523-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "cinder-dc3f3cee-55cf-4b23-9105-ed2e74c60a08-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-dc3f3cee-55cf-4b23-9105-ed2e74c60a08-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:36 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "cinder-quobyte-dc3f3cee-55cf-4b23-9105-ed2e74c60a08" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-quobyte-dc3f3cee-55cf-4b23-9105-ed2e74c60a08" acquired by "delete_volume" :: waited 0.013s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:36 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[426e1279-73a4-4bca-bcfd-8fda3728859c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08" returned: 0 in 0.461s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-dc3f3cee-55cf-4b23-9105-ed2e74c60a08" returned: 0 in 0.095s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-quobyte-dc3f3cee-55cf-4b23-9105-ed2e74c60a08" released by "delete_volume" :: held 0.737s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:37 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Created reservations ['76fd163c-9793-4472-adf1-d23d57468b08', 'a15c563f-dc21-4cff-b9d2-6a85cac72736', '390b1ead-446c-4c4d-93f1-6738a4f11c3b', 'cbea7089-ae49-40b0-88d0-b72df2987a57'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:33:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.121s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:37 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:33:37 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Deleted volume successfully. Sep 16 22:33:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8f9ab36d-7045-4fff-9072-f21351e20bd9 tempest-VolumesListTestJSON-1293960291 None] Lock "cinder-dc3f3cee-55cf-4b23-9105-ed2e74c60a08-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Acquiring lock "cinder-1538d833-b729-414e-a538-6a5af2965a3b-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "cinder-1538d833-b729-414e-a538-6a5af2965a3b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:39 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Acquiring lock "cinder-quobyte-1538d833-b729-414e-a538-6a5af2965a3b" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "cinder-quobyte-1538d833-b729-414e-a538-6a5af2965a3b" acquired by "delete_volume" :: waited 0.018s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:39 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[830c76be-3918-48c3-9982-b0e7d9dd6df8]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1538d833-b729-414e-a538-6a5af2965a3b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1538d833-b729-414e-a538-6a5af2965a3b" returned: 0 in 0.624s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1538d833-b729-414e-a538-6a5af2965a3b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1538d833-b729-414e-a538-6a5af2965a3b" returned: 0 in 0.220s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:40 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "cinder-quobyte-1538d833-b729-414e-a538-6a5af2965a3b" released by "delete_volume" :: held 1.023s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:41 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Created reservations ['63438777-1f11-4195-ad4d-2b6666252257', '037fd8f9-1533-4ee9-81c6-206efc25162a', 'deb78951-5111-47ce-8c70-ede0649a191b', '20f2de8e-2ce2-4d75-81e5-bd6b6e9dd4db'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:33:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.130s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:41 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:33:41 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Deleted volume successfully. Sep 16 22:33:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-567107fd-b606-47d9-9f7e-63b215065e89 tempest-AttachSCSIVolumeTestJSON-1515928220 None] Lock "cinder-1538d833-b729-414e-a538-6a5af2965a3b-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:42 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:42 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:33:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Flow 'volume_create_manager' (0f98f15b-2140-47b5-9ee3-a8e953e6568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ce60c1-7046-4076-abe2-11c1c5909366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ce60c1-7046-4076-abe2-11c1c5909366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-622060905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e15755-9552-44ea-8470-2fdaec93c173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151d335374541a4a1519436dbdd62ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:43Z,use_quota=True,user_id='f6bf256ea18441e2bac9b7392f2ffc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b604168-264f-4b73-bc73-523a55a69e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b604168-264f-4b73-bc73-523a55a69e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203a5a39-95be-497e-9d1f-16962f89ce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203a5a39-95be-497e-9d1f-16962f89ce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e15755-9552-44ea-8470-2fdaec93c173', 'volume_name': 'volume-b5e15755-9552-44ea-8470-2fdaec93c173', 'volume_size': 2}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad5979a-e805-4675-824f-59a5f0e3665a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad5979a-e805-4675-824f-59a5f0e3665a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa38ce94-9f36-4836-b748-f65e259cd252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:43 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Volume b5e15755-9552-44ea-8470-2fdaec93c173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e15755-9552-44ea-8470-2fdaec93c173', 'volume_size': 2} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-622060905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e15755-9552-44ea-8470-2fdaec93c173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151d335374541a4a1519436dbdd62ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:43Z,use_quota=True,user_id='f6bf256ea18441e2bac9b7392f2ffc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Creating volume b5e15755-9552-44ea-8470-2fdaec93c173 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:33:43 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173 2147483648 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:43 devstack quobyte-client[83246]: System call of process 87758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:33:43 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=40, name=volume-b5e15755-9552-44ea-8470-2fdaec93c173, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173 2147483648" returned: 0 in 0.566s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173" returned: 0 in 0.153s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] <== create_volume: return (821ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:33:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa38ce94-9f36-4836-b748-f65e259cd252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e15755-9552-44ea-8470-2fdaec93c173', 'volume_size': 2}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f13cef0-5552-4bff-b18b-d2e207e86b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:44 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Volume volume-b5e15755-9552-44ea-8470-2fdaec93c173 (b5e15755-9552-44ea-8470-2fdaec93c173): created successfully Sep 16 22:33:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f13cef0-5552-4bff-b18b-d2e207e86b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Flow 'volume_create_manager' (0f98f15b-2140-47b5-9ee3-a8e953e6568d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:44 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a919bc0d-dbb6-41a3-aba0-ed4aa1fc38a4 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Created volume successfully. Sep 16 22:33:45 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Creating offline snapshot 314658e1-128b-4845-8558-f1dcd4ee6d05 of volume b5e15755-9552-44ea-8470-2fdaec93c173 {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:33:45 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bea15ae-1183-47b9-83dd-152259d0175b]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173" returned: 0 in 0.527s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05 2G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:46 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=41, name=volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:33:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05 2G" returned: 0 in 0.346s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b5e15755-9552-44ea-8470-2fdaec93c173 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "qemu-img rebase -u -b volume-b5e15755-9552-44ea-8470-2fdaec93c173 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05" returned: 0 in 0.219s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:46 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:33:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05" returned: 0 in 0.111s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:46 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:33:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05" returned: 0 in 0.325s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.info" returned: 0 in 0.177s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:33:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.info" returned: 0 in 0.235s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:48 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-cfadf915-c717-4b2c-8ee9-1b686980fe28 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Create snapshot completed successfully Sep 16 22:33:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Acquiring lock "cinder-314658e1-128b-4845-8558-f1dcd4ee6d05-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "cinder-314658e1-128b-4845-8558-f1dcd4ee6d05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:48 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Acquiring lock "cinder-quobyte-b5e15755-9552-44ea-8470-2fdaec93c173" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "cinder-quobyte-b5e15755-9552-44ea-8470-2fdaec93c173" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Acquiring lock "cinder-quobyte-314658e1-128b-4845-8558-f1dcd4ee6d05" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "cinder-quobyte-314658e1-128b-4845-8558-f1dcd4ee6d05" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Deleting offline snapshot 314658e1-128b-4845-8558-f1dcd4ee6d05 of volume b5e15755-9552-44ea-8470-2fdaec93c173 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:33:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] snapshot_file for this snap is: volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:33:48 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8597d28b-44b0-453e-ae9c-0cbd64bf71c5]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:49 devstack quobyte-client[83246]: System call of process 87779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:33:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05" returned: 0 in 0.621s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5e15755-9552-44ea-8470-2fdaec93c173(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:33:49 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f837db-c0a3-44d5-81b2-e2167f567fea]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173" returned: 0 in 0.638s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05" returned: 0 in 0.319s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173.314658e1-128b-4845-8558-f1dcd4ee6d05" returned: 0 in 0.151s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "cinder-quobyte-314658e1-128b-4845-8558-f1dcd4ee6d05" released by "_delete_snapshot" :: held 2.166s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "cinder-quobyte-b5e15755-9552-44ea-8470-2fdaec93c173" released by "delete_snapshot" :: held 2.206s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:51 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Created reservations ['ba0cf9a0-0149-4f4c-8870-f2dfabffc7bd', '99201ae0-6f4f-474d-9f06-b554bd01ce25', '9b44084d-855b-433e-8a52-025083f01d3c', '388610a5-8d6b-4c68-8de2-35a08d119267'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:33:51 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Delete snapshot completed successfully. Sep 16 22:33:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f198597-ffa2-4bb5-8000-95d163e38e31 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "cinder-314658e1-128b-4845-8558-f1dcd4ee6d05-delete_snapshot" released by "delete_snapshot" :: held 2.833s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Acquiring lock "cinder-b5e15755-9552-44ea-8470-2fdaec93c173-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "cinder-b5e15755-9552-44ea-8470-2fdaec93c173-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:52 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Acquiring lock "cinder-quobyte-b5e15755-9552-44ea-8470-2fdaec93c173" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:33:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "cinder-quobyte-b5e15755-9552-44ea-8470-2fdaec93c173" acquired by "delete_volume" :: waited 0.020s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:33:52 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e5499-a538-4997-b33c-92dec496645b]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:33:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173" returned: 0 in 0.526s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b5e15755-9552-44ea-8470-2fdaec93c173" returned: 0 in 0.137s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:53 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "cinder-quobyte-b5e15755-9552-44ea-8470-2fdaec93c173" released by "delete_volume" :: held 0.873s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:54 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Created reservations ['e16591d5-723f-46ca-81ca-fa67f348c57d', 'ca415e1e-4d41-456e-9dab-26b2ca3c9e91', '427d16a2-bc39-45f3-b39a-86ae085a199a', '66d38c19-fcce-409b-9ea8-08a7582e0288'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:33:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:33:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:33:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:33:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:33:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:33:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:33:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.379s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:33:55 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:33:55 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Deleted volume successfully. Sep 16 22:33:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1c2aa19d-f49d-4229-85f6-5017ae5ee9b7 tempest-VolumesSnapshotNegativeTestJSON-742127056 None] Lock "cinder-b5e15755-9552-44ea-8470-2fdaec93c173-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:33:59 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:33:59 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:33:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Flow 'volume_create_manager' (55cb7afe-14dc-422c-a9bb-a315058554a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:33:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc30591-792d-4368-b260-31c56d2138bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc30591-792d-4368-b260-31c56d2138bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2084743242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79a6ab2-21bf-4a7e-8039-16f6440f979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee91c8ab7c6e4e36b0589d2770f929ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:59Z,use_quota=True,user_id='0b7ef1770dfc478fa34625677b7783e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a953ad2e-6f8e-42d7-90d1-6a72ed12c192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a953ad2e-6f8e-42d7-90d1-6a72ed12c192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529834f6-6125-4875-952c-111fb147940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:33:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529834f6-6125-4875-952c-111fb147940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c79a6ab2-21bf-4a7e-8039-16f6440f979e', 'volume_name': 'volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:33:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45baf06-1eea-4c25-baf6-5781909e2224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45baf06-1eea-4c25-baf6-5781909e2224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e128d8-8cf7-459f-8f4d-1dbeacb2c4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:34:00 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Volume c79a6ab2-21bf-4a7e-8039-16f6440f979e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e', 'volume_size': 1} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2084743242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79a6ab2-21bf-4a7e-8039-16f6440f979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee91c8ab7c6e4e36b0589d2770f929ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:33:59Z,use_quota=True,user_id='0b7ef1770dfc478fa34625677b7783e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Creating volume c79a6ab2-21bf-4a7e-8039-16f6440f979e {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:34:00 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:34:00 devstack quobyte-client[83246]: System call of process 87808 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:34:00 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=43, name=volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e 1073741824" returned: 0 in 0.585s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e" returned: 0 in 0.155s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] <== create_volume: return (865ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:34:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:34:01 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=71,cinder:DELETE=6,cinder:SELECT=52,cinder:INSERT=19 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:34:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e128d8-8cf7-459f-8f4d-1dbeacb2c4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:34:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04962d5d-48c8-4ca5-a231-dffc9eade502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:34:01 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Volume volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e (c79a6ab2-21bf-4a7e-8039-16f6440f979e): created successfully Sep 16 22:34:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04962d5d-48c8-4ca5-a231-dffc9eade502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:34:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Flow 'volume_create_manager' (55cb7afe-14dc-422c-a9bb-a315058554a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:34:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c55ad66b-4d15-45f0-b9bd-778265e1664c tempest-AttachVolumeNegativeTest-662030524 None] Created volume successfully. Sep 16 22:34:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-e17ead8f-27e5-4c86-a9ef-76fb2c3eff7e req-bdc4f51f-cf69-40ab-8d67-f87e50a4b0ba tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:34:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-e17ead8f-27e5-4c86-a9ef-76fb2c3eff7e req-bdc4f51f-cf69-40ab-8d67-f87e50a4b0ba tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:34:05 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[02938420-b6b9-4ed6-93a4-33911b194000]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:34:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-e17ead8f-27e5-4c86-a9ef-76fb2c3eff7e req-bdc4f51f-cf69-40ab-8d67-f87e50a4b0ba tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:34:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-e17ead8f-27e5-4c86-a9ef-76fb2c3eff7e req-bdc4f51f-cf69-40ab-8d67-f87e50a4b0ba tempest-AttachVolumeNegativeTest-662030524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e" returned: 0 in 0.558s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:34:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-e17ead8f-27e5-4c86-a9ef-76fb2c3eff7e req-bdc4f51f-cf69-40ab-8d67-f87e50a4b0ba tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.623s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:34:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-e17ead8f-27e5-4c86-a9ef-76fb2c3eff7e req-bdc4f51f-cf69-40ab-8d67-f87e50a4b0ba tempest-AttachVolumeNegativeTest-662030524 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78074041-2e72-4e0a-b87f-666799857cba', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:34:06 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-e17ead8f-27e5-4c86-a9ef-76fb2c3eff7e req-bdc4f51f-cf69-40ab-8d67-f87e50a4b0ba tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:34:06 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-e17ead8f-27e5-4c86-a9ef-76fb2c3eff7e req-bdc4f51f-cf69-40ab-8d67-f87e50a4b0ba tempest-AttachVolumeNegativeTest-662030524 None] attachment_update completed successfully. Sep 16 22:34:16 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=34,cinder:INSERT=6,cinder:UPDATE=42,cinder:DELETE=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:34:16 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:DELETE=1,cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:34:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:34:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:34:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:34:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:34:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:34:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:34:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:34:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.164s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:34:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:35:13 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:35:13 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:35:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Flow 'volume_create_manager' (3a58999f-8816-4ad4-944d-b69c6dc3a2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:35:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ba690b-373c-4b7c-98b1-f4edac5efbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ba690b-373c-4b7c-98b1-f4edac5efbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-257774165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28f8f98-fa4b-4636-9fc4-f322b914cf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673501b92b9f42cea552e32e748ce2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:35:12Z,use_quota=True,user_id='30c6954a32594639a2b9171bbb4ddcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed76454b-9703-4d9c-894b-5e3c3380b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed76454b-9703-4d9c-894b-5e3c3380b23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1af2363-9130-4a30-b6f3-3b1bc541959a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1af2363-9130-4a30-b6f3-3b1bc541959a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28f8f98-fa4b-4636-9fc4-f322b914cf24', 'volume_name': 'volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37082307-644f-45d2-82c7-70f1e60e3f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37082307-644f-45d2-82c7-70f1e60e3f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e3b74c-3983-44ef-91b9-d2624e39f30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:14 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Volume d28f8f98-fa4b-4636-9fc4-f322b914cf24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24', 'volume_size': 1} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-257774165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28f8f98-fa4b-4636-9fc4-f322b914cf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673501b92b9f42cea552e32e748ce2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:35:12Z,use_quota=True,user_id='30c6954a32594639a2b9171bbb4ddcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Creating volume d28f8f98-fa4b-4636-9fc4-f322b914cf24 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:35:14 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:35:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:35:14 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=44, name=volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:35:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24 1073741824" returned: 0 in 1.145s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:35:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:35:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24" returned: 0 in 0.427s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:35:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] <== create_volume: return (1910ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:35:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:35:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e3b74c-3983-44ef-91b9-d2624e39f30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9417aa06-edea-48f5-93a8-4ccbf82cae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:17 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Volume volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24 (d28f8f98-fa4b-4636-9fc4-f322b914cf24): created successfully Sep 16 22:35:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9417aa06-edea-48f5-93a8-4ccbf82cae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Flow 'volume_create_manager' (3a58999f-8816-4ad4-944d-b69c6dc3a2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:35:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ff2ae9a5-6227-4319-ae06-4a1eca29c515 tempest-TestMinimumBasicScenario-1054510649 None] Created volume successfully. Sep 16 22:35:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-39d16d0e-fc39-4dc4-aadc-ef5808ff5df0 req-fbbee9c1-4684-4969-bf70-c3f0ff5174d6 tempest-TestMinimumBasicScenario-1054510649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:35:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-39d16d0e-fc39-4dc4-aadc-ef5808ff5df0 req-fbbee9c1-4684-4969-bf70-c3f0ff5174d6 tempest-TestMinimumBasicScenario-1054510649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.015s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:35:27 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3d9df9-c4e9-448f-874c-6ac3593fe083]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:35:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-39d16d0e-fc39-4dc4-aadc-ef5808ff5df0 req-fbbee9c1-4684-4969-bf70-c3f0ff5174d6 tempest-TestMinimumBasicScenario-1054510649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:35:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:35:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:35:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.039s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:35:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:35:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:35:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:35:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:35:28 devstack quobyte-client[83246]: System call of process 88592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:35:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.470s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:35:29 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:35:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-39d16d0e-fc39-4dc4-aadc-ef5808ff5df0 req-fbbee9c1-4684-4969-bf70-c3f0ff5174d6 tempest-TestMinimumBasicScenario-1054510649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24" returned: 0 in 2.146s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:35:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-39d16d0e-fc39-4dc4-aadc-ef5808ff5df0 req-fbbee9c1-4684-4969-bf70-c3f0ff5174d6 tempest-TestMinimumBasicScenario-1054510649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.370s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:35:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-39d16d0e-fc39-4dc4-aadc-ef5808ff5df0 req-fbbee9c1-4684-4969-bf70-c3f0ff5174d6 tempest-TestMinimumBasicScenario-1054510649 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92f0838c-df80-4ae1-910b-e29986fe0d14', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:35:29 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-39d16d0e-fc39-4dc4-aadc-ef5808ff5df0 req-fbbee9c1-4684-4969-bf70-c3f0ff5174d6 tempest-TestMinimumBasicScenario-1054510649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:35:29 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-39d16d0e-fc39-4dc4-aadc-ef5808ff5df0 req-fbbee9c1-4684-4969-bf70-c3f0ff5174d6 tempest-TestMinimumBasicScenario-1054510649 None] attachment_update completed successfully. Sep 16 22:35:39 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:35:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:35:47 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:35:47 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:35:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Flow 'volume_create_manager' (3478effb-0301-46b2-ba44-7d7c093c5d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:35:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea1c57a-c331-4257-bca2-16289b567a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea1c57a-c331-4257-bca2-16289b567a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-279818926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dfd35d-bccd-4a74-b56f-e8e407984f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbaa02a8d7b4e0bbc75566ae606857b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:35:48Z,use_quota=True,user_id='d83e382774124c3eb8be4a1dbaffe1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0ec32e-4592-4658-bc51-c0fa0ae290af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0ec32e-4592-4658-bc51-c0fa0ae290af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e35b6c-bff5-4652-89c9-21bcb6611500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e35b6c-bff5-4652-89c9-21bcb6611500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0dfd35d-bccd-4a74-b56f-e8e407984f63', 'volume_name': 'volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5caa05fc-7350-49bd-9b9e-4cd7911fcecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5caa05fc-7350-49bd-9b9e-4cd7911fcecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4250ec4-90f6-4e4e-a7aa-a617a11a82e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:48 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Volume f0dfd35d-bccd-4a74-b56f-e8e407984f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63', 'volume_size': 1} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-279818926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dfd35d-bccd-4a74-b56f-e8e407984f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbaa02a8d7b4e0bbc75566ae606857b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:35:48Z,use_quota=True,user_id='d83e382774124c3eb8be4a1dbaffe1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Creating volume f0dfd35d-bccd-4a74-b56f-e8e407984f63 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:35:48 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:35:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:35:48 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=45, name=volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:35:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63 1073741824" returned: 0 in 0.920s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:35:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:35:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63" returned: 0 in 0.360s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:35:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] <== create_volume: return (1550ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:35:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:35:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4250ec4-90f6-4e4e-a7aa-a617a11a82e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4b4f7c-a708-4474-8042-231566ce3d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:35:49 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Volume volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63 (f0dfd35d-bccd-4a74-b56f-e8e407984f63): created successfully Sep 16 22:35:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4b4f7c-a708-4474-8042-231566ce3d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:35:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Flow 'volume_create_manager' (3478effb-0301-46b2-ba44-7d7c093c5d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:35:50 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-cdfde86e-2f38-4a2f-a4d7-d264f0348470 tempest-VolumesAdminNegativeTest-1333361991 None] Created volume successfully. Sep 16 22:35:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Acquiring lock "cinder-f0dfd35d-bccd-4a74-b56f-e8e407984f63-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:35:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Lock "cinder-f0dfd35d-bccd-4a74-b56f-e8e407984f63-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:35:51 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:35:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Acquiring lock "cinder-quobyte-f0dfd35d-bccd-4a74-b56f-e8e407984f63" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:35:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Lock "cinder-quobyte-f0dfd35d-bccd-4a74-b56f-e8e407984f63" acquired by "delete_volume" :: waited 0.018s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:35:51 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde39cec-69a1-402d-9525-e6f0691b5c7c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:35:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:35:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63" returned: 0 in 1.055s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:35:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:35:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f0dfd35d-bccd-4a74-b56f-e8e407984f63" returned: 0 in 0.213s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:35:53 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Lock "cinder-quobyte-f0dfd35d-bccd-4a74-b56f-e8e407984f63" released by "delete_volume" :: held 1.756s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:35:53 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Created reservations ['449a4308-d68d-4440-8024-2dbf48f0ee92', '1dcffbd3-1536-4869-9875-529ca60eb0ce', 'a1c3f84d-cc89-4b44-a2b9-2670ecc38d18', '240e1fb5-1d03-4180-a8b7-3037426c9da5'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:35:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:35:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:35:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:35:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:35:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:35:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:35:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.161s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:35:54 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:35:54 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Deleted volume successfully. Sep 16 22:35:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-65a29dab-1f15-4a13-82a7-d4687bf77579 tempest-VolumesAdminNegativeTest-1333361991 None] Lock "cinder-f0dfd35d-bccd-4a74-b56f-e8e407984f63-delete_volume" released by "delete_volume" :: held 3.477s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:36:04 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:36:04 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:36:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:36:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:36:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:36:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:36:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:36:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:36:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:36:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.593s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:36:29 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:37:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2dda1215-fe79-454e-97f0-39e680e0d544 req-8c9e0993-4971-4b24-8b4a-28d46b07fe1d tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:37:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2dda1215-fe79-454e-97f0-39e680e0d544 req-8c9e0993-4971-4b24-8b4a-28d46b07fe1d tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:37:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-2dda1215-fe79-454e-97f0-39e680e0d544 req-8c9e0993-4971-4b24-8b4a-28d46b07fe1d tempest-AttachVolumeNegativeTest-662030524 None] Terminate volume connection completed successfully. Sep 16 22:37:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-2dda1215-fe79-454e-97f0-39e680e0d544 req-8c9e0993-4971-4b24-8b4a-28d46b07fe1d tempest-AttachVolumeNegativeTest-662030524 None] Deleting attachment 78074041-2e72-4e0a-b87f-666799857cba. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:37:11 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:37:11 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:37:20 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Flow 'volume_create_manager' (ec077aad-20f0-42f5-90f6-bc023da31436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbd7cf0-6a0f-4b07-ae01-00cf91f381a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbd7cf0-6a0f-4b07-ae01-00cf91f381a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-823444933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9aecb3-28f0-41e7-86b2-5d75fc9a5071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c6942cb8ee4f2e99fc7ef6f79a8cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:37:20Z,use_quota=True,user_id='f5815613033d45a6ad5d85663fca39ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb7b22f-24ec-475c-b1b0-9b383f8b2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb7b22f-24ec-475c-b1b0-9b383f8b2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b551b8-1270-4e4c-b3a0-a0c8a7ec8238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b551b8-1270-4e4c-b3a0-a0c8a7ec8238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9aecb3-28f0-41e7-86b2-5d75fc9a5071', 'volume_name': 'volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3af291-4c3e-48e1-8d1c-3f50bf633388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3af291-4c3e-48e1-8d1c-3f50bf633388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3201e951-d5fd-4f68-9146-f9fecdff9c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:37:20 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Volume 8e9aecb3-28f0-41e7-86b2-5d75fc9a5071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071', 'volume_size': 1} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-823444933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9aecb3-28f0-41e7-86b2-5d75fc9a5071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c6942cb8ee4f2e99fc7ef6f79a8cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:37:20Z,use_quota=True,user_id='f5815613033d45a6ad5d85663fca39ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Creating volume 8e9aecb3-28f0-41e7-86b2-5d75fc9a5071 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:37:20 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:37:20 devstack quobyte-client[83246]: System call of process 89224 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:37:20 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=46, name=volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071 1073741824" returned: 0 in 0.369s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:37:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:37:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071" returned: 0 in 0.112s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:37:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] <== create_volume: return (566ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:37:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.581s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:37:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3201e951-d5fd-4f68-9146-f9fecdff9c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:37:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8f8458-b81f-41a1-a90d-9d85b8534aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:37:21 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Volume volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071 (8e9aecb3-28f0-41e7-86b2-5d75fc9a5071): created successfully Sep 16 22:37:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8f8458-b81f-41a1-a90d-9d85b8534aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:37:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Flow 'volume_create_manager' (ec077aad-20f0-42f5-90f6-bc023da31436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:37:21 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-2ea5120d-7b99-44bc-9175-1acf94389eed tempest-TaggedAttachmentsTest-1595558348 None] Created volume successfully. Sep 16 22:37:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:37:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:37:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:37:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:37:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:37:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:37:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:37:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.201s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:37:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:37:31 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=2,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:37:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:38:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:38:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:38:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:38:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:38:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:38:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:38:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:38:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.100s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:38:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:38:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-94e867ef-474d-4b06-b549-96cc9ebfc0f2 req-1a3395fd-f5ce-4ccb-b1b3-37a3d94b02ba tempest-TestMinimumBasicScenario-1054510649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:38:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-94e867ef-474d-4b06-b549-96cc9ebfc0f2 req-1a3395fd-f5ce-4ccb-b1b3-37a3d94b02ba tempest-TestMinimumBasicScenario-1054510649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:38:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-94e867ef-474d-4b06-b549-96cc9ebfc0f2 req-1a3395fd-f5ce-4ccb-b1b3-37a3d94b02ba tempest-TestMinimumBasicScenario-1054510649 None] Terminate volume connection completed successfully. Sep 16 22:38:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-94e867ef-474d-4b06-b549-96cc9ebfc0f2 req-1a3395fd-f5ce-4ccb-b1b3-37a3d94b02ba tempest-TestMinimumBasicScenario-1054510649 None] Deleting attachment 92f0838c-df80-4ae1-910b-e29986fe0d14. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:38:32 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Acquiring lock "cinder-d28f8f98-fa4b-4636-9fc4-f322b914cf24-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:38:32 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Lock "cinder-d28f8f98-fa4b-4636-9fc4-f322b914cf24-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:38:32 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:38:32 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Acquiring lock "cinder-quobyte-d28f8f98-fa4b-4636-9fc4-f322b914cf24" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:38:32 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Lock "cinder-quobyte-d28f8f98-fa4b-4636-9fc4-f322b914cf24" acquired by "delete_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:38:32 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0373135-b048-4815-b3af-82089090f76a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:38:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24" returned: 0 in 0.527s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d28f8f98-fa4b-4636-9fc4-f322b914cf24" returned: 0 in 0.111s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Lock "cinder-quobyte-d28f8f98-fa4b-4636-9fc4-f322b914cf24" released by "delete_volume" :: held 0.785s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Created reservations ['7c9889b0-30d1-4a7a-89ac-a9fab8fbbb39', 'f32caf8a-9288-4d6e-b33a-0e91e16d256e', '7a7ad47b-82c8-4caf-9fa3-a86a78fe2332', '11064e7d-4d74-4632-a5ef-6997ff013ff7'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.095s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:38:33 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:38:34 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Deleted volume successfully. Sep 16 22:38:34 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-581bb62f-8717-4feb-a892-088fb9d06524 tempest-TestMinimumBasicScenario-1054510649 None] Lock "cinder-d28f8f98-fa4b-4636-9fc4-f322b914cf24-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:38:43 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:38:44 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:38:58 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Flow 'volume_create_manager' (ae136197-d378-437e-8152-9672a00f5cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13669351-251d-4d1c-888f-883b7106a7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13669351-251d-4d1c-888f-883b7106a7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2020725401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8de0a52-f311-406f-be23-108e21faefab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee91c8ab7c6e4e36b0589d2770f929ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:38:58Z,use_quota=True,user_id='0b7ef1770dfc478fa34625677b7783e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3584d94a-0640-4b53-8c7d-6952ac24d38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3584d94a-0640-4b53-8c7d-6952ac24d38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a6da9e-8fef-4bf6-a3ca-2b0cd5f6dcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a6da9e-8fef-4bf6-a3ca-2b0cd5f6dcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8de0a52-f311-406f-be23-108e21faefab', 'volume_name': 'volume-e8de0a52-f311-406f-be23-108e21faefab', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2e223b-d21d-44e2-97bf-5617a58c6698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2e223b-d21d-44e2-97bf-5617a58c6698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2160e45-cd3a-4d6e-9ccc-ce2e0954244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:38:58 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Volume e8de0a52-f311-406f-be23-108e21faefab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8de0a52-f311-406f-be23-108e21faefab', 'volume_size': 1} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2020725401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8de0a52-f311-406f-be23-108e21faefab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee91c8ab7c6e4e36b0589d2770f929ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:38:58Z,use_quota=True,user_id='0b7ef1770dfc478fa34625677b7783e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Creating volume e8de0a52-f311-406f-be23-108e21faefab {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:38:58 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:38:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e8de0a52-f311-406f-be23-108e21faefab 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:38:59 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=47, name=volume-e8de0a52-f311-406f-be23-108e21faefab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:38:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e8de0a52-f311-406f-be23-108e21faefab 1073741824" returned: 0 in 0.958s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:38:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e8de0a52-f311-406f-be23-108e21faefab {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:39:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e8de0a52-f311-406f-be23-108e21faefab" returned: 0 in 0.138s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:39:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] <== create_volume: return (1236ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:39:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:39:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2160e45-cd3a-4d6e-9ccc-ce2e0954244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8de0a52-f311-406f-be23-108e21faefab', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:39:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb3674f-8b57-458e-8458-99a28cb331fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:39:00 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Volume volume-e8de0a52-f311-406f-be23-108e21faefab (e8de0a52-f311-406f-be23-108e21faefab): created successfully Sep 16 22:39:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb3674f-8b57-458e-8458-99a28cb331fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:39:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Flow 'volume_create_manager' (ae136197-d378-437e-8152-9672a00f5cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:39:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-254d1291-6e0a-4532-96cd-19c0641cf7d4 tempest-AttachVolumeNegativeTest-662030524 None] Created volume successfully. Sep 16 22:39:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-10aad475-0853-4cac-9d35-bad72a10f41c req-b04f26ae-7e4f-4ffd-8f34-be704408336c tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:39:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-10aad475-0853-4cac-9d35-bad72a10f41c req-b04f26ae-7e4f-4ffd-8f34-be704408336c tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:39:06 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[62edfdb7-066b-46b3-bba5-5b4111f27c7f]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:39:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-10aad475-0853-4cac-9d35-bad72a10f41c req-b04f26ae-7e4f-4ffd-8f34-be704408336c tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e8de0a52-f311-406f-be23-108e21faefab {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:39:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-10aad475-0853-4cac-9d35-bad72a10f41c req-b04f26ae-7e4f-4ffd-8f34-be704408336c tempest-AttachVolumeNegativeTest-662030524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e8de0a52-f311-406f-be23-108e21faefab" returned: 0 in 0.504s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:39:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-10aad475-0853-4cac-9d35-bad72a10f41c req-b04f26ae-7e4f-4ffd-8f34-be704408336c tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.595s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:39:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-10aad475-0853-4cac-9d35-bad72a10f41c req-b04f26ae-7e4f-4ffd-8f34-be704408336c tempest-AttachVolumeNegativeTest-662030524 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-e8de0a52-f311-406f-be23-108e21faefab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '680b4386-1927-445f-8fa8-6580b9051063', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:39:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-10aad475-0853-4cac-9d35-bad72a10f41c req-b04f26ae-7e4f-4ffd-8f34-be704408336c tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:39:07 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-10aad475-0853-4cac-9d35-bad72a10f41c req-b04f26ae-7e4f-4ffd-8f34-be704408336c tempest-AttachVolumeNegativeTest-662030524 None] attachment_update completed successfully. Sep 16 22:39:17 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:39:17 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:39:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:39:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:39:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:39:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:39:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:39:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:39:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:39:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.222s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:39:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:39:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-5cf81410-9c6e-4bcc-bac5-f25daf431794 req-579f157a-a2b9-4451-8b06-79e45a358b65 tempest-TaggedAttachmentsTest-1595558348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:39:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-5cf81410-9c6e-4bcc-bac5-f25daf431794 req-579f157a-a2b9-4451-8b06-79e45a358b65 tempest-TaggedAttachmentsTest-1595558348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:39:29 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d875867-abc4-49c4-afd8-e27383cae1de]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:39:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-5cf81410-9c6e-4bcc-bac5-f25daf431794 req-579f157a-a2b9-4451-8b06-79e45a358b65 tempest-TaggedAttachmentsTest-1595558348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:39:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-5cf81410-9c6e-4bcc-bac5-f25daf431794 req-579f157a-a2b9-4451-8b06-79e45a358b65 tempest-TaggedAttachmentsTest-1595558348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071" returned: 0 in 0.525s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:39:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-5cf81410-9c6e-4bcc-bac5-f25daf431794 req-579f157a-a2b9-4451-8b06-79e45a358b65 tempest-TaggedAttachmentsTest-1595558348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.612s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:39:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-5cf81410-9c6e-4bcc-bac5-f25daf431794 req-579f157a-a2b9-4451-8b06-79e45a358b65 tempest-TaggedAttachmentsTest-1595558348 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d0ce6a8-1fc0-4b9f-a5bd-d4ea9e5367b1', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:39:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-5cf81410-9c6e-4bcc-bac5-f25daf431794 req-579f157a-a2b9-4451-8b06-79e45a358b65 tempest-TaggedAttachmentsTest-1595558348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:39:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-5cf81410-9c6e-4bcc-bac5-f25daf431794 req-579f157a-a2b9-4451-8b06-79e45a358b65 tempest-TaggedAttachmentsTest-1595558348 None] attachment_update completed successfully. Sep 16 22:39:36 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-51183480-2408-44f6-9341-2d4b69d4e00d req-c8b78368-c9dc-4631-9903-4dfafa7a150e tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:39:36 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-51183480-2408-44f6-9341-2d4b69d4e00d req-c8b78368-c9dc-4631-9903-4dfafa7a150e tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:39:36 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-51183480-2408-44f6-9341-2d4b69d4e00d req-c8b78368-c9dc-4631-9903-4dfafa7a150e tempest-AttachVolumeNegativeTest-662030524 None] Terminate volume connection completed successfully. Sep 16 22:39:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-51183480-2408-44f6-9341-2d4b69d4e00d req-c8b78368-c9dc-4631-9903-4dfafa7a150e tempest-AttachVolumeNegativeTest-662030524 None] Deleting attachment 680b4386-1927-445f-8fa8-6580b9051063. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:39:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:39:46 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:39:59 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-817b8351-3ed1-4a41-83d4-28e1c3ee1c46 req-d46bc642-c656-4c3d-b21a-e074bf30d41d tempest-TaggedAttachmentsTest-1595558348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:39:59 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-817b8351-3ed1-4a41-83d4-28e1c3ee1c46 req-d46bc642-c656-4c3d-b21a-e074bf30d41d tempest-TaggedAttachmentsTest-1595558348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:39:59 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-817b8351-3ed1-4a41-83d4-28e1c3ee1c46 req-d46bc642-c656-4c3d-b21a-e074bf30d41d tempest-TaggedAttachmentsTest-1595558348 None] Terminate volume connection completed successfully. Sep 16 22:40:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-817b8351-3ed1-4a41-83d4-28e1c3ee1c46 req-d46bc642-c656-4c3d-b21a-e074bf30d41d tempest-TaggedAttachmentsTest-1595558348 None] Deleting attachment 0d0ce6a8-1fc0-4b9f-a5bd-d4ea9e5367b1. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:40:09 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:40:10 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:40:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:40:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:40:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:40:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:40:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:40:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:40:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:40:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.188s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:40:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:40:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Acquiring lock "cinder-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:40:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Lock "cinder-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:40:46 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:40:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Acquiring lock "cinder-quobyte-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:40:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Lock "cinder-quobyte-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071" acquired by "delete_volume" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:40:46 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[829c3833-e725-4241-bd3c-988cc79b3eb1]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:40:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071" returned: 0 in 0.449s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071" returned: 0 in 0.082s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Lock "cinder-quobyte-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071" released by "delete_volume" :: held 0.704s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Created reservations ['7ae5d1c1-e89d-40c5-a6c1-2c42abaa5287', 'c7320579-d13f-4f3f-93d6-efe092093408', 'b60b9d1f-a8d9-4ec2-b3dc-c0cbe909bc69', 'f9c8e845-44ac-4b02-b92b-e0f5f65f5722'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:40:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:40:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.154s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:40:48 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:40:48 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Deleted volume successfully. Sep 16 22:40:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7075d08b-845f-43a9-996a-f0fb75dde91a tempest-TaggedAttachmentsTest-1595558348 None] Lock "cinder-8e9aecb3-28f0-41e7-86b2-5d75fc9a5071-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:40:57 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=4,cinder:UPDATE=13 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:40:58 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:41:13 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:41:13 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Flow 'volume_create_manager' (ea464718-d335-4658-9df7-7aa69bff195d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc12907-eb8e-46bc-b811-9b2e951c84e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc12907-eb8e-46bc-b811-9b2e951c84e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-937968581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95657534-ac0c-4fec-9265-9cedb05af2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa2c480845e4aa49f4a3dec53ab0f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:41:14Z,use_quota=True,user_id='8875f2dcb6594b1fa0555c41e5d2910e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a95d27-2724-4e89-8a94-42e6a437ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a95d27-2724-4e89-8a94-42e6a437ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93390981-4a4a-4514-91a1-05126642dd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93390981-4a4a-4514-91a1-05126642dd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95657534-ac0c-4fec-9265-9cedb05af2b6', 'volume_name': 'volume-95657534-ac0c-4fec-9265-9cedb05af2b6', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e13e1e-715c-4cbd-93e5-a7b45962eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e13e1e-715c-4cbd-93e5-a7b45962eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851aec08-cb47-4c79-a2d3-95d22d4cab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:14 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Volume 95657534-ac0c-4fec-9265-9cedb05af2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95657534-ac0c-4fec-9265-9cedb05af2b6', 'volume_size': 1} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-937968581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95657534-ac0c-4fec-9265-9cedb05af2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa2c480845e4aa49f4a3dec53ab0f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:41:14Z,use_quota=True,user_id='8875f2dcb6594b1fa0555c41e5d2910e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Creating volume 95657534-ac0c-4fec-9265-9cedb05af2b6 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:41:14 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-95657534-ac0c-4fec-9265-9cedb05af2b6 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:41:14 devstack quobyte-client[83246]: System call of process 90797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:41:14 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=48, name=volume-95657534-ac0c-4fec-9265-9cedb05af2b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-95657534-ac0c-4fec-9265-9cedb05af2b6 1073741824" returned: 0 in 0.410s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-95657534-ac0c-4fec-9265-9cedb05af2b6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-95657534-ac0c-4fec-9265-9cedb05af2b6" returned: 0 in 0.134s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] <== create_volume: return (656ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:41:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:41:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851aec08-cb47-4c79-a2d3-95d22d4cab35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95657534-ac0c-4fec-9265-9cedb05af2b6', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a6a764-22da-4324-91cd-c18e1ef78971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:15 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Volume volume-95657534-ac0c-4fec-9265-9cedb05af2b6 (95657534-ac0c-4fec-9265-9cedb05af2b6): created successfully Sep 16 22:41:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a6a764-22da-4324-91cd-c18e1ef78971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Flow 'volume_create_manager' (ea464718-d335-4658-9df7-7aa69bff195d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:41:15 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-4c54fed6-dd0b-4d9e-9f61-8130ff338d45 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Created volume successfully. Sep 16 22:41:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-1ee5338b-3117-46f5-97df-e368d733f885 req-7626d183-d301-44f8-a265-936d9de57df1 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:41:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-1ee5338b-3117-46f5-97df-e368d733f885 req-7626d183-d301-44f8-a265-936d9de57df1 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:41:20 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be72f31-c237-4bca-8d17-abb6a843c9be]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:41:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-1ee5338b-3117-46f5-97df-e368d733f885 req-7626d183-d301-44f8-a265-936d9de57df1 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-95657534-ac0c-4fec-9265-9cedb05af2b6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:41:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-1ee5338b-3117-46f5-97df-e368d733f885 req-7626d183-d301-44f8-a265-936d9de57df1 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-95657534-ac0c-4fec-9265-9cedb05af2b6" returned: 0 in 0.691s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:41:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-1ee5338b-3117-46f5-97df-e368d733f885 req-7626d183-d301-44f8-a265-936d9de57df1 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.763s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:41:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-1ee5338b-3117-46f5-97df-e368d733f885 req-7626d183-d301-44f8-a265-936d9de57df1 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-95657534-ac0c-4fec-9265-9cedb05af2b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f6aef31-a5cd-4695-8d26-f135642c3c78', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:41:21 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-1ee5338b-3117-46f5-97df-e368d733f885 req-7626d183-d301-44f8-a265-936d9de57df1 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:41:21 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-1ee5338b-3117-46f5-97df-e368d733f885 req-7626d183-d301-44f8-a265-936d9de57df1 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] attachment_update completed successfully. Sep 16 22:41:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:41:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:41:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:41:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:41:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:41:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:41:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:41:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.169s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:41:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:41:31 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:41:34 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:41:34 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:41:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Flow 'volume_create_manager' (8715f379-4e3f-46e3-b87c-89df28b5aeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:41:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c5fc60-bdaa-477f-90ef-a470c4b9288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c5fc60-bdaa-477f-90ef-a470c4b9288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1429166239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132e17cb-0ae9-4445-a81c-91ea43f87a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee91c8ab7c6e4e36b0589d2770f929ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:41:35Z,use_quota=True,user_id='0b7ef1770dfc478fa34625677b7783e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567c14be-5f65-4e23-8a40-6b553fc2d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567c14be-5f65-4e23-8a40-6b553fc2d396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50242f2e-19e9-4fae-851d-0017640e7b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50242f2e-19e9-4fae-851d-0017640e7b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132e17cb-0ae9-4445-a81c-91ea43f87a23', 'volume_name': 'volume-132e17cb-0ae9-4445-a81c-91ea43f87a23', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bcbab9-6c24-4a46-b3f4-8ec98ab96e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bcbab9-6c24-4a46-b3f4-8ec98ab96e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc62a56-6e2a-47a0-ad0f-fb0eae028bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:35 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Volume 132e17cb-0ae9-4445-a81c-91ea43f87a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132e17cb-0ae9-4445-a81c-91ea43f87a23', 'volume_size': 1} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1429166239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132e17cb-0ae9-4445-a81c-91ea43f87a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee91c8ab7c6e4e36b0589d2770f929ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:41:35Z,use_quota=True,user_id='0b7ef1770dfc478fa34625677b7783e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Creating volume 132e17cb-0ae9-4445-a81c-91ea43f87a23 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:41:35 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:41:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-132e17cb-0ae9-4445-a81c-91ea43f87a23 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:41:35 devstack quobyte-client[83246]: System call of process 91241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:41:35 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=49, name=volume-132e17cb-0ae9-4445-a81c-91ea43f87a23, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:41:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-132e17cb-0ae9-4445-a81c-91ea43f87a23 1073741824" returned: 0 in 0.734s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:41:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-132e17cb-0ae9-4445-a81c-91ea43f87a23 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:41:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-132e17cb-0ae9-4445-a81c-91ea43f87a23" returned: 0 in 0.410s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:41:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] <== create_volume: return (1503ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:41:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:41:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc62a56-6e2a-47a0-ad0f-fb0eae028bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132e17cb-0ae9-4445-a81c-91ea43f87a23', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d326693e-093d-460d-b02d-ef22a9c7acd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:41:37 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Volume volume-132e17cb-0ae9-4445-a81c-91ea43f87a23 (132e17cb-0ae9-4445-a81c-91ea43f87a23): created successfully Sep 16 22:41:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d326693e-093d-460d-b02d-ef22a9c7acd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:41:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Flow 'volume_create_manager' (8715f379-4e3f-46e3-b87c-89df28b5aeb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:41:37 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6ef2800e-93be-4264-8508-b88f9fbf8e5c tempest-AttachVolumeNegativeTest-662030524 None] Created volume successfully. Sep 16 22:41:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-16d4179b-62c6-47e9-997f-ef98073ce85e req-ef6f1a0a-a8dc-4f8a-a18d-ae88267e1fc7 tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:41:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-16d4179b-62c6-47e9-997f-ef98073ce85e req-ef6f1a0a-a8dc-4f8a-a18d-ae88267e1fc7 tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:41:42 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bbd2fa-9586-499f-8ae5-f3dc213c443e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:41:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-16d4179b-62c6-47e9-997f-ef98073ce85e req-ef6f1a0a-a8dc-4f8a-a18d-ae88267e1fc7 tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-132e17cb-0ae9-4445-a81c-91ea43f87a23 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:41:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-16d4179b-62c6-47e9-997f-ef98073ce85e req-ef6f1a0a-a8dc-4f8a-a18d-ae88267e1fc7 tempest-AttachVolumeNegativeTest-662030524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-132e17cb-0ae9-4445-a81c-91ea43f87a23" returned: 0 in 0.534s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:41:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-16d4179b-62c6-47e9-997f-ef98073ce85e req-ef6f1a0a-a8dc-4f8a-a18d-ae88267e1fc7 tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.644s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:41:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-16d4179b-62c6-47e9-997f-ef98073ce85e req-ef6f1a0a-a8dc-4f8a-a18d-ae88267e1fc7 tempest-AttachVolumeNegativeTest-662030524 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-132e17cb-0ae9-4445-a81c-91ea43f87a23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '780ce3ba-f5c0-464f-bf22-1039274b8c7f', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:41:43 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-16d4179b-62c6-47e9-997f-ef98073ce85e req-ef6f1a0a-a8dc-4f8a-a18d-ae88267e1fc7 tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:41:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-16d4179b-62c6-47e9-997f-ef98073ce85e req-ef6f1a0a-a8dc-4f8a-a18d-ae88267e1fc7 tempest-AttachVolumeNegativeTest-662030524 None] attachment_update completed successfully. Sep 16 22:41:53 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:41:53 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:41:54 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-42f9c18e-2b9c-4383-8753-1241f094ef29 req-54e4da21-e6ab-424b-a49f-bdbd28919344 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:41:54 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-42f9c18e-2b9c-4383-8753-1241f094ef29 req-54e4da21-e6ab-424b-a49f-bdbd28919344 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:41:54 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-42f9c18e-2b9c-4383-8753-1241f094ef29 req-54e4da21-e6ab-424b-a49f-bdbd28919344 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Terminate volume connection completed successfully. Sep 16 22:41:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-42f9c18e-2b9c-4383-8753-1241f094ef29 req-54e4da21-e6ab-424b-a49f-bdbd28919344 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Deleting attachment 8f6aef31-a5cd-4695-8d26-f135642c3c78. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:41:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Acquiring lock "cinder-95657534-ac0c-4fec-9265-9cedb05af2b6-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:41:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "cinder-95657534-ac0c-4fec-9265-9cedb05af2b6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:41:55 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:41:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Acquiring lock "cinder-quobyte-95657534-ac0c-4fec-9265-9cedb05af2b6" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:41:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "cinder-quobyte-95657534-ac0c-4fec-9265-9cedb05af2b6" acquired by "delete_volume" :: waited 0.017s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:41:55 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[07932743-dc5c-4d9c-8540-09da8b454e78]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:41:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-95657534-ac0c-4fec-9265-9cedb05af2b6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:41:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-95657534-ac0c-4fec-9265-9cedb05af2b6" returned: 0 in 0.439s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:41:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-95657534-ac0c-4fec-9265-9cedb05af2b6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:41:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-95657534-ac0c-4fec-9265-9cedb05af2b6" returned: 0 in 0.128s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:41:56 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "cinder-quobyte-95657534-ac0c-4fec-9265-9cedb05af2b6" released by "delete_volume" :: held 0.740s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:41:56 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Created reservations ['cee60c70-fc23-4337-91be-6e54cb23dc0d', '9177be4f-5def-4490-9be4-1a66b58fa38f', '5e5c093a-9800-4e9f-be9b-71076f17a77f', '893d8b1f-ed51-43eb-969b-3cbf054875fc'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:41:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:41:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:41:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:41:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:41:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:41:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:41:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.092s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:41:57 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:41:57 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Deleted volume successfully. Sep 16 22:41:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9f72aeba-8e75-41e3-8e99-9753bdb119a8 tempest-TestServerVolumeAttachScenarioOldVersion-1519097677 None] Lock "cinder-95657534-ac0c-4fec-9265-9cedb05af2b6-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:42:06 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:42:07 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:42:12 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-d77afeea-1c00-4c5e-91b7-20abf3e6d95c req-c25d2ca6-738b-46b9-be18-0a6dcfab6cf1 tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:42:12 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-d77afeea-1c00-4c5e-91b7-20abf3e6d95c req-c25d2ca6-738b-46b9-be18-0a6dcfab6cf1 tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:42:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-d77afeea-1c00-4c5e-91b7-20abf3e6d95c req-c25d2ca6-738b-46b9-be18-0a6dcfab6cf1 tempest-AttachVolumeNegativeTest-662030524 None] Terminate volume connection completed successfully. Sep 16 22:42:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-d77afeea-1c00-4c5e-91b7-20abf3e6d95c req-c25d2ca6-738b-46b9-be18-0a6dcfab6cf1 tempest-AttachVolumeNegativeTest-662030524 None] Deleting attachment 780ce3ba-f5c0-464f-bf22-1039274b8c7f. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:42:22 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:42:22 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:42:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:42:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:42:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:42:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:42:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:42:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:42:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.429s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:42:34 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "cinder-132e17cb-0ae9-4445-a81c-91ea43f87a23-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:42:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-132e17cb-0ae9-4445-a81c-91ea43f87a23-delete_volume" acquired by "delete_volume" :: waited 0.952s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:42:35 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:42:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "cinder-quobyte-132e17cb-0ae9-4445-a81c-91ea43f87a23" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:42:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-quobyte-132e17cb-0ae9-4445-a81c-91ea43f87a23" acquired by "delete_volume" :: waited 0.029s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:42:35 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[35920d68-1c4e-492d-8e22-e2ad0f4a2228]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:42:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-132e17cb-0ae9-4445-a81c-91ea43f87a23 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-132e17cb-0ae9-4445-a81c-91ea43f87a23" returned: 0 in 1.309s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-132e17cb-0ae9-4445-a81c-91ea43f87a23 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-132e17cb-0ae9-4445-a81c-91ea43f87a23" returned: 0 in 0.129s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-quobyte-132e17cb-0ae9-4445-a81c-91ea43f87a23" released by "delete_volume" :: held 1.848s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:42:39 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Created reservations ['41a23a67-9b45-4bd0-8fa6-f0c344acfce6', '6e0851dc-bf7f-4c6d-83d8-a7fd134ff86b', '11e323d4-db81-4510-aa9b-60fc283c0811', 'ffd8c86b-6c26-4ba2-8819-0d08cd3d2e6c'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:42:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:42:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:42:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:42:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:42:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:42:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.326s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:39 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:42:40 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Deleted volume successfully. Sep 16 22:42:40 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "cinder-e8de0a52-f311-406f-be23-108e21faefab-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:42:40 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3d6bee95-168f-45cf-87b6-4eda1ea09922 tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-132e17cb-0ae9-4445-a81c-91ea43f87a23-delete_volume" released by "delete_volume" :: held 5.468s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:42:40 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-e8de0a52-f311-406f-be23-108e21faefab-delete_volume" acquired by "delete_volume" :: waited 0.236s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:42:41 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:42:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "cinder-quobyte-e8de0a52-f311-406f-be23-108e21faefab" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:42:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-quobyte-e8de0a52-f311-406f-be23-108e21faefab" acquired by "delete_volume" :: waited 0.035s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:42:41 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b40172d-9e45-4f6a-9f62-9ce6c6c370e2]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:42:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e8de0a52-f311-406f-be23-108e21faefab {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e8de0a52-f311-406f-be23-108e21faefab" returned: 0 in 1.263s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e8de0a52-f311-406f-be23-108e21faefab {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e8de0a52-f311-406f-be23-108e21faefab" returned: 0 in 0.250s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-quobyte-e8de0a52-f311-406f-be23-108e21faefab" released by "delete_volume" :: held 1.849s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:42:43 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Created reservations ['2422ae89-6882-4840-bce7-e005b6e1af0c', '69bf8d38-7213-4057-a580-7d924adf3e7c', '2090f5de-0a5d-4192-bb34-4e5d0de469f7', 'da5482a3-be37-4b3b-a69d-26dc4bb3dae9'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:42:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:42:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:42:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:42:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:42:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:42:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.347s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:45 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:42:45 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Deleted volume successfully. Sep 16 22:42:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-504f8f4d-cfce-4cb8-b41c-bcb0fbdb6ffb tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-e8de0a52-f311-406f-be23-108e21faefab-delete_volume" released by "delete_volume" :: held 5.487s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:42:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "cinder-c79a6ab2-21bf-4a7e-8039-16f6440f979e-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:42:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-c79a6ab2-21bf-4a7e-8039-16f6440f979e-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:42:46 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:42:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "cinder-quobyte-c79a6ab2-21bf-4a7e-8039-16f6440f979e" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:42:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-quobyte-c79a6ab2-21bf-4a7e-8039-16f6440f979e" acquired by "delete_volume" :: waited 0.049s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:42:46 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ee67a6-8647-4ed5-9f49-53a105e56907]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:42:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:47 devstack quobyte-client[83246]: System call of process 91804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:42:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e" returned: 0 in 1.163s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c79a6ab2-21bf-4a7e-8039-16f6440f979e" returned: 0 in 0.233s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-quobyte-c79a6ab2-21bf-4a7e-8039-16f6440f979e" released by "delete_volume" :: held 1.792s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:42:48 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Created reservations ['1b00fae8-3eda-4cf8-9ce1-b124d210e034', '25685839-0b95-4f4d-be8f-2206ac6d26d7', '5eeffe5d-9e66-4047-a89e-676294f1fe9b', 'fa403b0b-7f85-4d65-b55c-a97145b78dcb'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:42:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:42:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:42:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:42:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:42:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:42:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.155s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:49 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:42:49 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Deleted volume successfully. Sep 16 22:42:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e98d4b35-ab14-410d-af06-86904cb0734a tempest-AttachVolumeNegativeTest-662030524 None] Lock "cinder-c79a6ab2-21bf-4a7e-8039-16f6440f979e-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:42:51 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Flow 'volume_create_manager' (2a4d327d-20b7-42e6-adbe-bc232df3043f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257df8db-43b0-41a3-aee4-b467b2c702a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257df8db-43b0-41a3-aee4-b467b2c702a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-912141570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860715b0-59db-4823-8c0d-9eec80b8cc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb39e8cb0ef44699e3fc9c0f09c0c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:42:52Z,use_quota=True,user_id='224be2b1a39f43d08870313745f064de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14692e02-a7f0-4d9b-a7ee-54b98aa767de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14692e02-a7f0-4d9b-a7ee-54b98aa767de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4dd38a-9a99-49ca-8216-64a67a5b174e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4dd38a-9a99-49ca-8216-64a67a5b174e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '860715b0-59db-4823-8c0d-9eec80b8cc03', 'volume_name': 'volume-860715b0-59db-4823-8c0d-9eec80b8cc03', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b792bd3a-6fc6-479b-8cdb-1444a3d9cc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b792bd3a-6fc6-479b-8cdb-1444a3d9cc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd11c3f4-7eb9-498c-bf66-f365b6c2de3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:52 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Volume 860715b0-59db-4823-8c0d-9eec80b8cc03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-860715b0-59db-4823-8c0d-9eec80b8cc03', 'volume_size': 1} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-912141570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860715b0-59db-4823-8c0d-9eec80b8cc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb39e8cb0ef44699e3fc9c0f09c0c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:42:52Z,use_quota=True,user_id='224be2b1a39f43d08870313745f064de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Creating volume 860715b0-59db-4823-8c0d-9eec80b8cc03 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:42:52 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:42:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-860715b0-59db-4823-8c0d-9eec80b8cc03 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:52 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=50, name=volume-860715b0-59db-4823-8c0d-9eec80b8cc03, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:42:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-860715b0-59db-4823-8c0d-9eec80b8cc03 1073741824" returned: 0 in 0.786s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-860715b0-59db-4823-8c0d-9eec80b8cc03 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-860715b0-59db-4823-8c0d-9eec80b8cc03" returned: 0 in 0.153s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] <== create_volume: return (1063ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:42:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:42:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd11c3f4-7eb9-498c-bf66-f365b6c2de3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860715b0-59db-4823-8c0d-9eec80b8cc03', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9613f91-6f72-40a9-b263-ea9d51eba84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:53 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Volume volume-860715b0-59db-4823-8c0d-9eec80b8cc03 (860715b0-59db-4823-8c0d-9eec80b8cc03): created successfully Sep 16 22:42:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9613f91-6f72-40a9-b263-ea9d51eba84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Flow 'volume_create_manager' (2a4d327d-20b7-42e6-adbe-bc232df3043f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:42:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-65c84c38-69cb-42b0-92f8-745b996f5de5 tempest-ServersNegativeTestJSON-1538958132 None] Created volume successfully. Sep 16 22:42:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Flow 'volume_create_manager' (e30a92f2-6938-44a8-aab6-c31599761519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26846914-9647-424c-b6d6-255077fbd350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26846914-9647-424c-b6d6-255077fbd350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1580568610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0b0cd2-c067-46fa-8731-d956b5328ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb39e8cb0ef44699e3fc9c0f09c0c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:42:57Z,use_quota=True,user_id='224be2b1a39f43d08870313745f064de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37073166-292f-47ff-abf5-0ee4d53709ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37073166-292f-47ff-abf5-0ee4d53709ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa2c50a-6f2f-4b9e-8810-9c3a3bbc03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa2c50a-6f2f-4b9e-8810-9c3a3bbc03f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0b0cd2-c067-46fa-8731-d956b5328ec7', 'volume_name': 'volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148f7d7d-f0bf-46e4-89f8-1fcdb257e268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148f7d7d-f0bf-46e4-89f8-1fcdb257e268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9759a7f-333f-4c62-924d-e5759e2a2b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:57 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Volume 5e0b0cd2-c067-46fa-8731-d956b5328ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7', 'volume_size': 1} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1580568610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0b0cd2-c067-46fa-8731-d956b5328ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb39e8cb0ef44699e3fc9c0f09c0c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:42:57Z,use_quota=True,user_id='224be2b1a39f43d08870313745f064de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Creating volume 5e0b0cd2-c067-46fa-8731-d956b5328ec7 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:42:57 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:57 devstack quobyte-client[83246]: System call of process 91831 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:42:57 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=51, name=volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7 1073741824" returned: 0 in 0.566s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:42:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7" returned: 0 in 0.258s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:42:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] <== create_volume: return (1012ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:42:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:42:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9759a7f-333f-4c62-924d-e5759e2a2b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e9a33d-90f4-4c6a-848c-dc88c5648e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:42:58 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Volume volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7 (5e0b0cd2-c067-46fa-8731-d956b5328ec7): created successfully Sep 16 22:42:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e9a33d-90f4-4c6a-848c-dc88c5648e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:42:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Flow 'volume_create_manager' (e30a92f2-6938-44a8-aab6-c31599761519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:42:58 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-18b1539f-2449-4896-a0ec-3d360b4c81f7 tempest-ServersNegativeTestJSON-1538958132 None] Created volume successfully. Sep 16 22:43:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Acquiring lock "cinder-5e0b0cd2-c067-46fa-8731-d956b5328ec7-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:43:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Lock "cinder-5e0b0cd2-c067-46fa-8731-d956b5328ec7-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:43:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Acquiring lock "cinder-quobyte-5e0b0cd2-c067-46fa-8731-d956b5328ec7" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:43:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Lock "cinder-quobyte-5e0b0cd2-c067-46fa-8731-d956b5328ec7" acquired by "delete_volume" :: waited 0.019s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:43:01 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b329280-a0a8-4291-8592-f9a6a1b57827]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:43:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7" returned: 0 in 1.620s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5e0b0cd2-c067-46fa-8731-d956b5328ec7" returned: 0 in 0.680s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Lock "cinder-quobyte-5e0b0cd2-c067-46fa-8731-d956b5328ec7" released by "delete_volume" :: held 2.563s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:43:05 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Created reservations ['dad46c5d-506b-4ed4-80cc-bef32c492529', '83fd56ff-b1fc-47a8-9e69-b7ec4da2ae42', '8e77111d-0ce3-4965-b826-3289ec9072c8', 'cbd25511-36d9-4267-a675-ccbb64583219'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:43:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.217s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:05 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:43:05 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Deleted volume successfully. Sep 16 22:43:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Acquiring lock "cinder-860715b0-59db-4823-8c0d-9eec80b8cc03-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:43:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-cae78780-01c5-4d92-ab31-3cb17a2095ef tempest-ServersNegativeTestJSON-1538958132 None] Lock "cinder-5e0b0cd2-c067-46fa-8731-d956b5328ec7-delete_volume" released by "delete_volume" :: held 5.180s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:43:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Lock "cinder-860715b0-59db-4823-8c0d-9eec80b8cc03-delete_volume" acquired by "delete_volume" :: waited 0.299s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:43:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Acquiring lock "cinder-quobyte-860715b0-59db-4823-8c0d-9eec80b8cc03" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:43:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Lock "cinder-quobyte-860715b0-59db-4823-8c0d-9eec80b8cc03" acquired by "delete_volume" :: waited 0.054s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:43:07 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[98af00cb-4f8b-4dd2-9407-ad77f5239e2b]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:43:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-860715b0-59db-4823-8c0d-9eec80b8cc03 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-860715b0-59db-4823-8c0d-9eec80b8cc03" returned: 0 in 0.623s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-860715b0-59db-4823-8c0d-9eec80b8cc03 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-860715b0-59db-4823-8c0d-9eec80b8cc03" returned: 0 in 0.171s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Lock "cinder-quobyte-860715b0-59db-4823-8c0d-9eec80b8cc03" released by "delete_volume" :: held 0.993s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Created reservations ['16188010-6cd7-48ac-b61a-983932c2e660', '909d6396-3f70-44dc-ab1c-376b4703a7b0', '2f3b3516-98b0-4d66-b57c-b2336931fc7d', '094a46d2-c7db-402d-a548-4bee30ee9a7a'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.144s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:09 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:43:09 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Deleted volume successfully. Sep 16 22:43:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-d9a02ce8-491b-434e-8750-ee2ec07a0964 tempest-ServersNegativeTestJSON-1538958132 None] Lock "cinder-860715b0-59db-4823-8c0d-9eec80b8cc03-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:43:15 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-32725f5b-b15a-488b-bcd9-876f8f009b76 tempest-GroupSnapshotsV319Test-60070912 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:15 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-32725f5b-b15a-488b-bcd9-876f8f009b76 tempest-GroupSnapshotsV319Test-60070912 None] Group tempest-GroupSnapshotsV319Test-Group-863512720: creating Sep 16 22:43:15 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-32725f5b-b15a-488b-bcd9-876f8f009b76 tempest-GroupSnapshotsV319Test-60070912 None] Group tempest-GroupSnapshotsV319Test-Group-863512720: created successfully Sep 16 22:43:15 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-32725f5b-b15a-488b-bcd9-876f8f009b76 tempest-GroupSnapshotsV319Test-60070912 None] Create group completed successfully. Sep 16 22:43:16 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Flow 'volume_create_manager' (ce8e630e-eb1d-484c-853d-47203408b1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52778fc4-cc48-4c5e-8432-acd05d30240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52778fc4-cc48-4c5e-8432-acd05d30240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-954695711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e89feb76-a12d-4243-b5bd-01a447b8f231,host='devstack@QuobyteHD#QuobyteHD',id=1be91e43-8849-4051-a917-db70a5938eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9460c6c875a84b94a5791b04c1b7bd54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:17Z,use_quota=True,user_id='8d3a6bf055dd43548eb70a0e064826ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97281937-60f6-440f-b3b2-5cbda539ed8c),volume_type_id=97281937-60f6-440f-b3b2-5cbda539ed8c)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02240420-c167-4959-8163-caa8dd93fa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02240420-c167-4959-8163-caa8dd93fa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0a7305-8df9-4263-81fa-3cdc9a9dd0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0a7305-8df9-4263-81fa-3cdc9a9dd0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be91e43-8849-4051-a917-db70a5938eef', 'volume_name': 'volume-1be91e43-8849-4051-a917-db70a5938eef', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb15c8f8-0fb2-4e13-b63c-c7082692a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb15c8f8-0fb2-4e13-b63c-c7082692a957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcea623b-7e0a-4942-a4ca-93cc3977c203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:16 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Volume 1be91e43-8849-4051-a917-db70a5938eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be91e43-8849-4051-a917-db70a5938eef', 'volume_size': 1} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e89feb76-a12d-4243-b5bd-01a447b8f231,created_at=2025-09-16T20:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-954695711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e89feb76-a12d-4243-b5bd-01a447b8f231,host='devstack@QuobyteHD#QuobyteHD',id=1be91e43-8849-4051-a917-db70a5938eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9460c6c875a84b94a5791b04c1b7bd54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:17Z,use_quota=True,user_id='8d3a6bf055dd43548eb70a0e064826ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97281937-60f6-440f-b3b2-5cbda539ed8c),volume_type_id=97281937-60f6-440f-b3b2-5cbda539ed8c)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Creating volume 1be91e43-8849-4051-a917-db70a5938eef {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:43:16 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:43:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:17 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=52, name=volume-1be91e43-8849-4051-a917-db70a5938eef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:43:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef 1073741824" returned: 0 in 0.347s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef" returned: 0 in 0.091s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] <== create_volume: return (506ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:43:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.523s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcea623b-7e0a-4942-a4ca-93cc3977c203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be91e43-8849-4051-a917-db70a5938eef', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555f0f47-f2c0-45ff-8803-5ad50a9194ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:17 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Volume volume-1be91e43-8849-4051-a917-db70a5938eef (1be91e43-8849-4051-a917-db70a5938eef): created successfully Sep 16 22:43:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555f0f47-f2c0-45ff-8803-5ad50a9194ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Flow 'volume_create_manager' (ce8e630e-eb1d-484c-853d-47203408b1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b342d924-0094-4548-92fb-8efbae846652 tempest-GroupSnapshotsV319Test-60070912 None] Created volume successfully. Sep 16 22:43:19 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] GroupSnapshot 80aa2a4a-618b-466d-841f-dc484d1514f9: creating. Sep 16 22:43:19 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Group snapshot 80aa2a4a-618b-466d-841f-dc484d1514f9: creating. {{(pid=83223) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 22:43:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Creating offline snapshot c9f5e455-0338-42cd-b211-06e2250ee31e of volume 1be91e43-8849-4051-a917-db70a5938eef {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:43:19 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b1d55d-fff5-485e-b916-6fa58a7c3f1a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:43:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef" returned: 0 in 0.481s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:20 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=53, name=volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:43:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e 1G" returned: 0 in 0.488s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1be91e43-8849-4051-a917-db70a5938eef -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:21 devstack quobyte-client[83246]: System call of process 91915 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:43:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] CMD "qemu-img rebase -u -b volume-1be91e43-8849-4051-a917-db70a5938eef -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e" returned: 0 in 0.372s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:43:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e" returned: 0 in 0.170s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:43:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e" returned: 0 in 0.219s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.info" returned: 0 in 0.193s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:22 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:43:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.info" returned: 0 in 0.125s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:23 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a7ab2272-39ea-4a2e-a24a-8dfd51fe59e4 tempest-GroupSnapshotsV319Test-60070912 None] group_snapshot 80aa2a4a-618b-466d-841f-dc484d1514f9: created successfully Sep 16 22:43:24 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] group_snapshot 80aa2a4a-618b-466d-841f-dc484d1514f9: deleting Sep 16 22:43:24 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:24 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] group_snapshot 80aa2a4a-618b-466d-841f-dc484d1514f9: deleting {{(pid=83223) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 22:43:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Acquiring lock "cinder-quobyte-1be91e43-8849-4051-a917-db70a5938eef" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:43:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Lock "cinder-quobyte-1be91e43-8849-4051-a917-db70a5938eef" acquired by "delete_snapshot" :: waited 0.179s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:43:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Acquiring lock "cinder-quobyte-c9f5e455-0338-42cd-b211-06e2250ee31e" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:43:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Lock "cinder-quobyte-c9f5e455-0338-42cd-b211-06e2250ee31e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:43:25 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Deleting offline snapshot c9f5e455-0338-42cd-b211-06e2250ee31e of volume 1be91e43-8849-4051-a917-db70a5938eef {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:43:25 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] snapshot_file for this snap is: volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:43:25 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5193f294-e696-4306-aa63-6cdf755cdc21]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:43:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:25 devstack quobyte-client[83246]: System call of process 91924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:43:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e" returned: 0 in 0.908s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be91e43-8849-4051-a917-db70a5938eef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:43:26 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[275f2ae3-46f4-42f9-81e2-d2f2edb6ba11]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:43:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:26 devstack quobyte-client[83246]: System call of process 91927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:43:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef" returned: 0 in 0.750s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:27 devstack quobyte-client[83246]: System call of process 91932 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:43:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e" returned: 0 in 0.386s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef.c9f5e455-0338-42cd-b211-06e2250ee31e" returned: 0 in 0.159s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:27 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Lock "cinder-quobyte-c9f5e455-0338-42cd-b211-06e2250ee31e" released by "_delete_snapshot" :: held 2.776s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:43:27 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Lock "cinder-quobyte-1be91e43-8849-4051-a917-db70a5938eef" released by "delete_snapshot" :: held 2.809s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:43:28 devstack cinder-volume[83223]: WARNING cinder.quota [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-599167306 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-599167306, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:43:28 devstack cinder-volume[83223]: WARNING cinder.quota [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-599167306 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-599167306, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:43:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:43:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.254s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:43:28 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] Created reservations ['c0bf3614-c436-4d7b-880b-26d7d87b87ac', '6cfabc63-a80e-4164-bbf6-f0a7ac228e86', '57a75822-a86b-4ac8-840e-ce28afd1c2e6', 'fd2555fa-e7b2-4e67-8719-532fce8554cc'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:43:29 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6651fbd4-bf85-43e9-aa26-5fd4d79186b9 tempest-GroupSnapshotsV319Test-60070912 None] group_snapshot 80aa2a4a-618b-466d-841f-dc484d1514f9: deleted successfully Sep 16 22:43:29 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Acquiring lock "cinder-quobyte-1be91e43-8849-4051-a917-db70a5938eef" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:43:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Lock "cinder-quobyte-1be91e43-8849-4051-a917-db70a5938eef" acquired by "delete_volume" :: waited 0.081s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:43:30 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f128f7c2-0776-4301-b1e0-a6cf20b622d6]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:43:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef" returned: 0 in 1.057s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1be91e43-8849-4051-a917-db70a5938eef" returned: 0 in 0.373s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Lock "cinder-quobyte-1be91e43-8849-4051-a917-db70a5938eef" released by "delete_volume" :: held 1.611s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:43:31 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Created reservations ['5a795df5-4d31-40b3-9fb6-9b70d66a618d'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:43:31 devstack cinder-volume[83223]: WARNING cinder.quota [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-599167306 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-599167306, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:43:32 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Created reservations ['c1abde08-6dd3-41d5-a968-b517bb98215f', 'c0968092-d490-4a7c-aac2-2e8883356091', 'da26c125-3e69-4221-8c7e-c8266e45a932', 'c19e0f59-0b8d-4de5-99a3-f5df827de869'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:43:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.135s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:32 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:43:32 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c2e9fc95-4495-4426-aced-e477e4af2372 tempest-GroupSnapshotsV319Test-60070912 None] Delete group completed successfully. Sep 16 22:43:35 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=55,cinder:INSERT=18,cinder:UPDATE=73,cinder:DELETE=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:43:35 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=60,cinder:SELECT=48,cinder:INSERT=11,cinder:DELETE=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:43:35 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:35 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:43:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Flow 'volume_create_manager' (bf98907b-1699-44bd-be1b-eed9eb11b249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976a7bd2-2157-4ce4-b5da-ff45c9f1b114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976a7bd2-2157-4ce4-b5da-ff45c9f1b114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-725697191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c8ca87-6a82-40fa-9fae-93f5a47e34c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564047c08bef4eafa4015ba25379d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:35Z,use_quota=True,user_id='3564ff31f3e549c793f147bfbe24bb58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7351c021-94e3-41dc-a485-07b5114a1dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7351c021-94e3-41dc-a485-07b5114a1dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f0d5fc-1752-409f-abc8-c57627de64b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f0d5fc-1752-409f-abc8-c57627de64b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63c8ca87-6a82-40fa-9fae-93f5a47e34c8', 'volume_name': 'volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2cebe0-4748-4301-90c5-b46073497001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2cebe0-4748-4301-90c5-b46073497001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f2abb9-b1e4-42d3-9f00-fcef220c8ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:36 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume 63c8ca87-6a82-40fa-9fae-93f5a47e34c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8', 'volume_size': 1} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-725697191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c8ca87-6a82-40fa-9fae-93f5a47e34c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564047c08bef4eafa4015ba25379d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:35Z,use_quota=True,user_id='3564ff31f3e549c793f147bfbe24bb58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Creating volume 63c8ca87-6a82-40fa-9fae-93f5a47e34c8 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:43:36 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:36 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=55, name=volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8 1073741824" returned: 0 in 0.600s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:36 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:36 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Flow 'volume_create_manager' (57e8c6c7-113e-4650-a58e-0ee3874f6d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119af29e-2abf-4125-84f3-27a1c2dbd0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119af29e-2abf-4125-84f3-27a1c2dbd0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1742400429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33757d8a-9ac0-44bc-be65-9cbae9a2a4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564047c08bef4eafa4015ba25379d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:36Z,use_quota=True,user_id='3564ff31f3e549c793f147bfbe24bb58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2ae69e-9175-46f1-949e-b57a1000a8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2ae69e-9175-46f1-949e-b57a1000a8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51894c76-7333-475f-966d-8af9d18351cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51894c76-7333-475f-966d-8af9d18351cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33757d8a-9ac0-44bc-be65-9cbae9a2a4d7', 'volume_name': 'volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2d499f-23a0-498e-a813-89619df67846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2d499f-23a0-498e-a813-89619df67846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046667da-d119-4506-86c3-62375ae3752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:37 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume 33757d8a-9ac0-44bc-be65-9cbae9a2a4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7', 'volume_size': 1} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8" returned: 0 in 0.636s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] <== create_volume: return (1281ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1742400429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33757d8a-9ac0-44bc-be65-9cbae9a2a4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564047c08bef4eafa4015ba25379d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:36Z,use_quota=True,user_id='3564ff31f3e549c793f147bfbe24bb58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Creating volume 33757d8a-9ac0-44bc-be65-9cbae9a2a4d7 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:43:37 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:37 devstack quobyte-client[83246]: System call of process 91948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:43:37 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=56, name=volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f2abb9-b1e4-42d3-9f00-fcef220c8ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abf1ebf-afb7-494d-ab92-b213c611f6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:37 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8 (63c8ca87-6a82-40fa-9fae-93f5a47e34c8): created successfully Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abf1ebf-afb7-494d-ab92-b213c611f6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Flow 'volume_create_manager' (bf98907b-1699-44bd-be1b-eed9eb11b249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7 1073741824" returned: 0 in 0.494s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7" returned: 0 in 0.186s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:43:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:38 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0b888d54-187e-4d05-b84f-1fe6b4568028 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Created volume successfully. Sep 16 22:43:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046667da-d119-4506-86c3-62375ae3752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4e17a8-0d86-4251-b27a-75dc4c1ec7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:38 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7 (33757d8a-9ac0-44bc-be65-9cbae9a2a4d7): created successfully Sep 16 22:43:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a4e17a8-0d86-4251-b27a-75dc4c1ec7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Flow 'volume_create_manager' (57e8c6c7-113e-4650-a58e-0ee3874f6d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:38 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-75fb0364-bc8e-4781-83bd-dd79e8123982 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Created volume successfully. Sep 16 22:43:42 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-42c2e781-1807-46d4-8966-a22d29200450 tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:42 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-42c2e781-1807-46d4-8966-a22d29200450 tempest-GroupsTest-1510949586 None] Group tempest-Group1-1719300847: creating Sep 16 22:43:42 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-42c2e781-1807-46d4-8966-a22d29200450 tempest-GroupsTest-1510949586 None] Group tempest-Group1-1719300847: created successfully Sep 16 22:43:42 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-42c2e781-1807-46d4-8966-a22d29200450 tempest-GroupsTest-1510949586 None] Create group completed successfully. Sep 16 22:43:43 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-79e53b3d-e7d1-4e92-b1d9-216dec855738 tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-79e53b3d-e7d1-4e92-b1d9-216dec855738 tempest-GroupsTest-1510949586 None] Group tempest-Group2-520519009: creating Sep 16 22:43:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-79e53b3d-e7d1-4e92-b1d9-216dec855738 tempest-GroupsTest-1510949586 None] Group tempest-Group2-520519009: created successfully Sep 16 22:43:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-79e53b3d-e7d1-4e92-b1d9-216dec855738 tempest-GroupsTest-1510949586 None] Create group completed successfully. Sep 16 22:43:45 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Flow 'volume_create_manager' (22ce428f-ade6-4a70-bbb4-358e1833c830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170dbc5d-ef0e-4afd-82dd-8bbaed2a1965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170dbc5d-ef0e-4afd-82dd-8bbaed2a1965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1214914795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6f0e81f-61bd-4799-b876-80d8822243a0,host='devstack@QuobyteHD#QuobyteHD',id=91c69945-3e2d-45cc-b52f-540bf670c5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d706e2b8993c47149d3279a5f35b438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:45Z,use_quota=True,user_id='22c2491c0a874d15b37fb6bcaee6fc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d704726-c9db-400e-b887-36f3aebef740),volume_type_id=8d704726-c9db-400e-b887-36f3aebef740)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1b716e-c2a3-44ec-86b5-1d81582a7aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1b716e-c2a3-44ec-86b5-1d81582a7aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a14e209-6157-460f-a290-416f1964c535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a14e209-6157-460f-a290-416f1964c535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c69945-3e2d-45cc-b52f-540bf670c5e4', 'volume_name': 'volume-91c69945-3e2d-45cc-b52f-540bf670c5e4', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd5e8c6-c9ef-4341-a937-c4ac0fbbcb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd5e8c6-c9ef-4341-a937-c4ac0fbbcb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65c2c2b-d8a4-435e-91dc-060719fee830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:45 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Volume 91c69945-3e2d-45cc-b52f-540bf670c5e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c69945-3e2d-45cc-b52f-540bf670c5e4', 'volume_size': 1} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a6f0e81f-61bd-4799-b876-80d8822243a0,created_at=2025-09-16T20:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1214914795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a6f0e81f-61bd-4799-b876-80d8822243a0,host='devstack@QuobyteHD#QuobyteHD',id=91c69945-3e2d-45cc-b52f-540bf670c5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d706e2b8993c47149d3279a5f35b438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:45Z,use_quota=True,user_id='22c2491c0a874d15b37fb6bcaee6fc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d704726-c9db-400e-b887-36f3aebef740),volume_type_id=8d704726-c9db-400e-b887-36f3aebef740)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Creating volume 91c69945-3e2d-45cc-b52f-540bf670c5e4 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:43:45 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91c69945-3e2d-45cc-b52f-540bf670c5e4 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:45 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=57, name=volume-91c69945-3e2d-45cc-b52f-540bf670c5e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91c69945-3e2d-45cc-b52f-540bf670c5e4 1073741824" returned: 0 in 0.433s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91c69945-3e2d-45cc-b52f-540bf670c5e4 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91c69945-3e2d-45cc-b52f-540bf670c5e4" returned: 0 in 0.196s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:46 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] <== create_volume: return (703ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:43:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65c2c2b-d8a4-435e-91dc-060719fee830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c69945-3e2d-45cc-b52f-540bf670c5e4', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3590b1a1-c4d4-4964-9df3-3322276f1652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:46 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Volume volume-91c69945-3e2d-45cc-b52f-540bf670c5e4 (91c69945-3e2d-45cc-b52f-540bf670c5e4): created successfully Sep 16 22:43:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3590b1a1-c4d4-4964-9df3-3322276f1652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Flow 'volume_create_manager' (22ce428f-ade6-4a70-bbb4-358e1833c830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:46 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-f9f7ed08-f5af-47e0-88ff-72aa316f3134 tempest-GroupsTest-1510949586 None] Created volume successfully. Sep 16 22:43:48 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Acquiring lock "cinder-quobyte-91c69945-3e2d-45cc-b52f-540bf670c5e4" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:43:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Lock "cinder-quobyte-91c69945-3e2d-45cc-b52f-540bf670c5e4" acquired by "delete_volume" :: waited 0.055s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:43:48 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f1648-f032-44f8-94f8-5707fd63b2d9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:43:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91c69945-3e2d-45cc-b52f-540bf670c5e4 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91c69945-3e2d-45cc-b52f-540bf670c5e4" returned: 0 in 0.542s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91c69945-3e2d-45cc-b52f-540bf670c5e4 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91c69945-3e2d-45cc-b52f-540bf670c5e4" returned: 0 in 0.142s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Lock "cinder-quobyte-91c69945-3e2d-45cc-b52f-540bf670c5e4" released by "delete_volume" :: held 0.979s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:43:49 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Created reservations ['5e564a32-ecff-461b-9f48-d4505b31a0ff'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:43:50 devstack cinder-volume[83223]: WARNING cinder.quota [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-777899357 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-777899357, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:43:50 devstack cinder-volume[83223]: WARNING cinder.quota [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-777899357 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-777899357, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:43:50 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Created reservations ['b48e399c-9b01-4b87-8e5c-7932578bca11', '1e3a8729-d843-4527-a4b8-278608f8bbb0', 'a7fbd8ee-7c24-48df-951e-83248aee094c', 'b45bcd91-9c4d-4be8-b628-948646858041'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:43:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.184s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:50 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:43:50 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e9f6abff-47da-4622-9290-6d0d9f8b77a6 tempest-GroupsTest-1510949586 None] Delete group completed successfully. Sep 16 22:43:51 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:51 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] Created reservations ['6bec0d0f-fc65-4ea1-993e-8a996bf16438'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:43:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.254s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:52 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:43:52 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c7daefd7-aca2-44b3-88aa-b3761292921e tempest-GroupsTest-1510949586 None] Delete group completed successfully. Sep 16 22:43:53 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-d0ee4a54-fe35-40d7-8eb2-ea2c19070ede tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d0ee4a54-fe35-40d7-8eb2-ea2c19070ede tempest-GroupsTest-1510949586 None] Group tempest-GroupsTest-Group-1417861654: creating Sep 16 22:43:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d0ee4a54-fe35-40d7-8eb2-ea2c19070ede tempest-GroupsTest-1510949586 None] Group tempest-GroupsTest-Group-1417861654: created successfully Sep 16 22:43:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d0ee4a54-fe35-40d7-8eb2-ea2c19070ede tempest-GroupsTest-1510949586 None] Create group completed successfully. Sep 16 22:43:54 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:54 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Flow 'volume_create_manager' (4c7aa11d-a9f8-438a-b23b-45772bf1e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edcb085-e615-4f27-a477-1ec4a3f303d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edcb085-e615-4f27-a477-1ec4a3f303d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-650728450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=800c935d-79d0-4703-9b90-9be71cc1b021,host='devstack@QuobyteHD#QuobyteHD',id=438a0cd8-7c74-4e2d-8ff0-07f5912a867b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d706e2b8993c47149d3279a5f35b438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:55Z,use_quota=True,user_id='22c2491c0a874d15b37fb6bcaee6fc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7faa7d8-8835-4780-a371-63fc0959f7ed),volume_type_id=a7faa7d8-8835-4780-a371-63fc0959f7ed)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938015ec-adac-4769-ac9e-fdcc9cd351b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938015ec-adac-4769-ac9e-fdcc9cd351b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31895784-0fc8-4d31-9f6d-20a13daaf1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31895784-0fc8-4d31-9f6d-20a13daaf1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438a0cd8-7c74-4e2d-8ff0-07f5912a867b', 'volume_name': 'volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997cfd86-9114-4f04-9bce-feb33d6e8618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997cfd86-9114-4f04-9bce-feb33d6e8618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0daf48c-604d-430e-a4e9-23eb57abe8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:55 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Volume 438a0cd8-7c74-4e2d-8ff0-07f5912a867b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b', 'volume_size': 1} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=800c935d-79d0-4703-9b90-9be71cc1b021,created_at=2025-09-16T20:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-650728450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=800c935d-79d0-4703-9b90-9be71cc1b021,host='devstack@QuobyteHD#QuobyteHD',id=438a0cd8-7c74-4e2d-8ff0-07f5912a867b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d706e2b8993c47149d3279a5f35b438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:55Z,use_quota=True,user_id='22c2491c0a874d15b37fb6bcaee6fc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7faa7d8-8835-4780-a371-63fc0959f7ed),volume_type_id=a7faa7d8-8835-4780-a371-63fc0959f7ed)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Creating volume 438a0cd8-7c74-4e2d-8ff0-07f5912a867b {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:43:55 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:55 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=58, name=volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b 1073741824" returned: 0 in 0.418s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b" returned: 0 in 0.128s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] <== create_volume: return (621ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.633s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0daf48c-604d-430e-a4e9-23eb57abe8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09f2c86-9e66-4574-a233-1fb3fa738c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:56 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Volume volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b (438a0cd8-7c74-4e2d-8ff0-07f5912a867b): created successfully Sep 16 22:43:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09f2c86-9e66-4574-a233-1fb3fa738c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Flow 'volume_create_manager' (4c7aa11d-a9f8-438a-b23b-45772bf1e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:56 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e699f4c6-daa5-4ee3-97fc-5be5df0d6d97 tempest-GroupsTest-1510949586 None] Created volume successfully. Sep 16 22:43:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Flow 'volume_create_manager' (17b42287-ac2c-4e1c-8dc0-f556c5d1b951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8006151c-a347-4b27-ad6f-e64f46264951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8006151c-a347-4b27-ad6f-e64f46264951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794343705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=800c935d-79d0-4703-9b90-9be71cc1b021,host='devstack@QuobyteHD#QuobyteHD',id=5a872079-9774-4a90-bbc5-3abac25d598d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d706e2b8993c47149d3279a5f35b438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:58Z,use_quota=True,user_id='22c2491c0a874d15b37fb6bcaee6fc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7faa7d8-8835-4780-a371-63fc0959f7ed),volume_type_id=a7faa7d8-8835-4780-a371-63fc0959f7ed)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406c4d0e-f09e-4cfb-ba15-447c93c8effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406c4d0e-f09e-4cfb-ba15-447c93c8effb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d505a846-f6cb-4265-ac28-55ba61813a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d505a846-f6cb-4265-ac28-55ba61813a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a872079-9774-4a90-bbc5-3abac25d598d', 'volume_name': 'volume-5a872079-9774-4a90-bbc5-3abac25d598d', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052aa88f-85bc-4b2c-a7d4-eb0ee8646474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052aa88f-85bc-4b2c-a7d4-eb0ee8646474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6da9d94-375a-4bf5-8c77-99bc567f597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:57 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Volume 5a872079-9774-4a90-bbc5-3abac25d598d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a872079-9774-4a90-bbc5-3abac25d598d', 'volume_size': 1} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=800c935d-79d0-4703-9b90-9be71cc1b021,created_at=2025-09-16T20:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794343705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=800c935d-79d0-4703-9b90-9be71cc1b021,host='devstack@QuobyteHD#QuobyteHD',id=5a872079-9774-4a90-bbc5-3abac25d598d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d706e2b8993c47149d3279a5f35b438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:43:58Z,use_quota=True,user_id='22c2491c0a874d15b37fb6bcaee6fc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7faa7d8-8835-4780-a371-63fc0959f7ed),volume_type_id=a7faa7d8-8835-4780-a371-63fc0959f7ed)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Creating volume 5a872079-9774-4a90-bbc5-3abac25d598d {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:43:57 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:43:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a872079-9774-4a90-bbc5-3abac25d598d 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:57 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=59, name=volume-5a872079-9774-4a90-bbc5-3abac25d598d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:43:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a872079-9774-4a90-bbc5-3abac25d598d 1073741824" returned: 0 in 0.302s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a872079-9774-4a90-bbc5-3abac25d598d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:43:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a872079-9774-4a90-bbc5-3abac25d598d" returned: 0 in 0.084s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:43:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] <== create_volume: return (455ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:43:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.465s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:43:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6da9d94-375a-4bf5-8c77-99bc567f597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a872079-9774-4a90-bbc5-3abac25d598d', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e7523a-7d9f-48e8-a682-05a1d98ccdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:43:58 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Volume volume-5a872079-9774-4a90-bbc5-3abac25d598d (5a872079-9774-4a90-bbc5-3abac25d598d): created successfully Sep 16 22:43:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e7523a-7d9f-48e8-a682-05a1d98ccdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:43:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Flow 'volume_create_manager' (17b42287-ac2c-4e1c-8dc0-f556c5d1b951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:43:58 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0d44aaf2-4619-4d00-8352-fdda28f89029 tempest-GroupsTest-1510949586 None] Created volume successfully. Sep 16 22:43:59 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0e578e0a-20b6-4891-942a-a62047e1e1fd tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:43:59 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0e578e0a-20b6-4891-942a-a62047e1e1fd tempest-GroupsTest-1510949586 None] Update group completed successfully. Sep 16 22:44:00 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e132ecb3-1918-41d2-8dcd-14f45851a4a9 tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:44:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e132ecb3-1918-41d2-8dcd-14f45851a4a9 tempest-GroupsTest-1510949586 None] Update group completed successfully. Sep 16 22:44:03 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:44:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Acquiring lock "cinder-quobyte-438a0cd8-7c74-4e2d-8ff0-07f5912a867b" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:44:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Lock "cinder-quobyte-438a0cd8-7c74-4e2d-8ff0-07f5912a867b" acquired by "delete_volume" :: waited 0.262s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:44:04 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a555bc7d-9ee1-4965-8a9c-b55460e3b0bf]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:44:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:44:05 devstack quobyte-client[83246]: System call of process 92095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:44:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b" returned: 0 in 1.980s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:44:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:44:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-438a0cd8-7c74-4e2d-8ff0-07f5912a867b" returned: 0 in 0.379s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:44:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Lock "cinder-quobyte-438a0cd8-7c74-4e2d-8ff0-07f5912a867b" released by "delete_volume" :: held 2.908s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:44:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Acquiring lock "cinder-quobyte-5a872079-9774-4a90-bbc5-3abac25d598d" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:44:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Lock "cinder-quobyte-5a872079-9774-4a90-bbc5-3abac25d598d" acquired by "delete_volume" :: waited 0.168s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:44:07 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8479e340-29f8-476c-895b-9b8fb4ff2e8c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:44:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a872079-9774-4a90-bbc5-3abac25d598d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:44:08 devstack quobyte-client[83246]: System call of process 92115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:44:08 devstack quobyte-client[83246]: System call of process 92115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:44:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a872079-9774-4a90-bbc5-3abac25d598d" returned: 0 in 1.398s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:44:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a872079-9774-4a90-bbc5-3abac25d598d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:44:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5a872079-9774-4a90-bbc5-3abac25d598d" returned: 0 in 0.166s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:44:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Lock "cinder-quobyte-5a872079-9774-4a90-bbc5-3abac25d598d" released by "delete_volume" :: held 2.092s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:44:10 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Created reservations ['b769bc8f-b102-47f0-8fa7-a87333fab081'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:44:10 devstack cinder-volume[83223]: WARNING cinder.quota [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1712583362 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1712583362, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:44:10 devstack cinder-volume[83223]: WARNING cinder.quota [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1712583362 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1712583362, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:44:10 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Created reservations ['a267daea-0611-4bd6-8fad-df2e9288bef9', 'fb36cd5c-a335-4e89-943b-dbc6d83cdd75', 'fd3f44bf-9e2e-4e30-a8b5-bc22c9c21cdb', '15cd40f8-2a7d-4c63-97db-204f9432e3ae'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:44:10 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Created reservations ['31196565-7516-4f64-8584-bbaa7931ad1f', '8bcb0527-b1b3-41bf-9ede-d943bbb451e3', 'f5a2eeb4-a547-45a9-a703-eec6b7efed76', '6f9ebadf-17f6-4e8b-9c0e-e2f03037a33b'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:44:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:44:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:44:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:44:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:44:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:44:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:44:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.149s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:44:11 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:44:11 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-95e55ab7-4d15-4f52-b506-221a972401e3 tempest-GroupsTest-1510949586 None] Delete group completed successfully. Sep 16 22:44:20 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=40,cinder:UPDATE=42,cinder:DELETE=1,cinder:INSERT=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:44:21 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=43,cinder:UPDATE=50,cinder:DELETE=4,cinder:INSERT=10 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:44:26 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ac6e4936-cd1c-4a73-836c-200d16d6809b tempest-GroupsV320Test-856821826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:44:26 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ac6e4936-cd1c-4a73-836c-200d16d6809b tempest-GroupsV320Test-856821826 None] Group tempest-GroupsV320Test-Group-70711109: creating Sep 16 22:44:26 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ac6e4936-cd1c-4a73-836c-200d16d6809b tempest-GroupsV320Test-856821826 None] Group tempest-GroupsV320Test-Group-70711109: created successfully Sep 16 22:44:26 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ac6e4936-cd1c-4a73-836c-200d16d6809b tempest-GroupsV320Test-856821826 None] Create group completed successfully. Sep 16 22:44:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:44:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:44:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:44:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:44:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:44:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:44:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:44:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.251s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:44:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:44:29 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:44:29 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] Created reservations ['1dab00f3-3c15-4011-a707-3ce5338f0dfb'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:44:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:44:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:44:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:44:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:44:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:44:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:44:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.217s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:44:30 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:44:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d2ba63ec-61f0-4ecf-be54-5df85f09ccf5 tempest-GroupsV320Test-856821826 None] Delete group completed successfully. Sep 16 22:44:40 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:44:40 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:45:06 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Flow 'volume_create_manager' (33f81786-3f60-4156-bdd7-1240a26bcba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae88efdd-a700-4fc5-8d00-98bb336a9199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae88efdd-a700-4fc5-8d00-98bb336a9199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1221941971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f701236-0b2a-45bf-b158-ba555df07a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56c0227606e4792b9d8919bc5888ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:45:06Z,use_quota=True,user_id='fc1108a2be0348efb686a7df61cb8085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7791fd5-0427-44bb-b72d-a93ac1718e60),volume_type_id=d7791fd5-0427-44bb-b72d-a93ac1718e60)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c7ea52-e62e-43cd-9c8f-5abf7f58bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c7ea52-e62e-43cd-9c8f-5abf7f58bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1762141-8d5e-487c-bff9-0e80ef9b2a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1762141-8d5e-487c-bff9-0e80ef9b2a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f701236-0b2a-45bf-b158-ba555df07a09', 'volume_name': 'volume-0f701236-0b2a-45bf-b158-ba555df07a09', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bbf5a6-81eb-49cc-8e58-8158aac44a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bbf5a6-81eb-49cc-8e58-8158aac44a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b51cf7-b769-475e-a547-8b31f2fda917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:06 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Volume 0f701236-0b2a-45bf-b158-ba555df07a09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f701236-0b2a-45bf-b158-ba555df07a09', 'volume_size': 1} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1221941971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f701236-0b2a-45bf-b158-ba555df07a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56c0227606e4792b9d8919bc5888ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:45:06Z,use_quota=True,user_id='fc1108a2be0348efb686a7df61cb8085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7791fd5-0427-44bb-b72d-a93ac1718e60),volume_type_id=d7791fd5-0427-44bb-b72d-a93ac1718e60)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Creating volume 0f701236-0b2a-45bf-b158-ba555df07a09 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:45:06 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:45:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f701236-0b2a-45bf-b158-ba555df07a09 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:07 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=60, name=volume-0f701236-0b2a-45bf-b158-ba555df07a09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:45:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f701236-0b2a-45bf-b158-ba555df07a09 1073741824" returned: 0 in 0.394s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f701236-0b2a-45bf-b158-ba555df07a09 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f701236-0b2a-45bf-b158-ba555df07a09" returned: 0 in 0.100s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] <== create_volume: return (571ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:45:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.584s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b51cf7-b769-475e-a547-8b31f2fda917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f701236-0b2a-45bf-b158-ba555df07a09', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6017fe20-3fdf-4fc5-8c1e-bced23e70486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:07 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Volume volume-0f701236-0b2a-45bf-b158-ba555df07a09 (0f701236-0b2a-45bf-b158-ba555df07a09): created successfully Sep 16 22:45:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6017fe20-3fdf-4fc5-8c1e-bced23e70486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Flow 'volume_create_manager' (33f81786-3f60-4156-bdd7-1240a26bcba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:45:07 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7b160081-cb14-4ff5-b372-ca895addda26 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Created volume successfully. Sep 16 22:45:08 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-700f29b5-3fcc-4da0-97ca-a0d5ec4fe2a1 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-700f29b5-3fcc-4da0-97ca-a0d5ec4fe2a1 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-700f29b5-3fcc-4da0-97ca-a0d5ec4fe2a1 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-700f29b5-3fcc-4da0-97ca-a0d5ec4fe2a1 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:45:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-700f29b5-3fcc-4da0-97ca-a0d5ec4fe2a1 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:45:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-700f29b5-3fcc-4da0-97ca-a0d5ec4fe2a1 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-700f29b5-3fcc-4da0-97ca-a0d5ec4fe2a1 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-700f29b5-3fcc-4da0-97ca-a0d5ec4fe2a1 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.107s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:09 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-700f29b5-3fcc-4da0-97ca-a0d5ec4fe2a1 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:45:09 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-700f29b5-3fcc-4da0-97ca-a0d5ec4fe2a1 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Retype volume completed successfully. Sep 16 22:45:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Acquiring lock "cinder-0f701236-0b2a-45bf-b158-ba555df07a09-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:45:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "cinder-0f701236-0b2a-45bf-b158-ba555df07a09-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:45:10 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Acquiring lock "cinder-quobyte-0f701236-0b2a-45bf-b158-ba555df07a09" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:45:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "cinder-quobyte-0f701236-0b2a-45bf-b158-ba555df07a09" acquired by "delete_volume" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:45:10 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc607ea-865d-4684-906e-8d51293a6d00]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:45:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f701236-0b2a-45bf-b158-ba555df07a09 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f701236-0b2a-45bf-b158-ba555df07a09" returned: 0 in 0.417s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f701236-0b2a-45bf-b158-ba555df07a09 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f701236-0b2a-45bf-b158-ba555df07a09" returned: 0 in 0.087s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "cinder-quobyte-0f701236-0b2a-45bf-b158-ba555df07a09" released by "delete_volume" :: held 0.653s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:45:11 devstack cinder-volume[83223]: WARNING cinder.quota [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:45:11 devstack cinder-volume[83223]: WARNING cinder.quota [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Created reservations ['6bd86e9d-b7ca-41b4-9001-e6b7c911b531', 'd1caee80-cd28-4699-98cb-ad8139ca695f', '46a0bf3b-c5e0-441a-8ae4-4d995f5ce660', 'c1b6d040-0126-40c1-bd39-fc8b7f07eaeb'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.092s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:11 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:45:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Deleted volume successfully. Sep 16 22:45:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-166206b3-6db2-41a9-8a8d-046e508de600 tempest-VolumeRetypeWithoutMigrationTest-1253374073 None] Lock "cinder-0f701236-0b2a-45bf-b158-ba555df07a09-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:45:19 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Flow 'volume_create_manager' (272e121b-3e30-4e5e-9ccf-634c301910ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3195ecf-6dc1-4c1a-89b7-41f1a8dc3d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3195ecf-6dc1-4c1a-89b7-41f1a8dc3d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-785711179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce43409-57ae-4730-b7c3-b84bfb967464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff8b0198f1243edbca8c13830630346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:45:19Z,use_quota=True,user_id='da186227c5214dc39ceba5ea373e8e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b48dd33-4595-42fe-9351-9a83b26806f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b48dd33-4595-42fe-9351-9a83b26806f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f34f3e-e950-49a6-884a-8819542eccc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f34f3e-e950-49a6-884a-8819542eccc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce43409-57ae-4730-b7c3-b84bfb967464', 'volume_name': 'volume-9ce43409-57ae-4730-b7c3-b84bfb967464', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a9ba18-9616-4080-ae01-7a0eb04b4b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a9ba18-9616-4080-ae01-7a0eb04b4b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c1504e-3201-4f93-b6c4-54c982dbf327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:19 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Volume 9ce43409-57ae-4730-b7c3-b84bfb967464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce43409-57ae-4730-b7c3-b84bfb967464', 'volume_size': 1} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-785711179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce43409-57ae-4730-b7c3-b84bfb967464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fff8b0198f1243edbca8c13830630346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:45:19Z,use_quota=True,user_id='da186227c5214dc39ceba5ea373e8e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Creating volume 9ce43409-57ae-4730-b7c3-b84bfb967464 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:45:19 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:45:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ce43409-57ae-4730-b7c3-b84bfb967464 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:19 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=61, name=volume-9ce43409-57ae-4730-b7c3-b84bfb967464, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:45:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ce43409-57ae-4730-b7c3-b84bfb967464 1073741824" returned: 0 in 0.524s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ce43409-57ae-4730-b7c3-b84bfb967464 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ce43409-57ae-4730-b7c3-b84bfb967464" returned: 0 in 0.445s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] <== create_volume: return (1206ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:45:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c1504e-3201-4f93-b6c4-54c982dbf327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce43409-57ae-4730-b7c3-b84bfb967464', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1833d38f-7066-4359-8d56-b7b05155f0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:21 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Volume volume-9ce43409-57ae-4730-b7c3-b84bfb967464 (9ce43409-57ae-4730-b7c3-b84bfb967464): created successfully Sep 16 22:45:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1833d38f-7066-4359-8d56-b7b05155f0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Flow 'volume_create_manager' (272e121b-3e30-4e5e-9ccf-634c301910ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:45:21 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-f7088b86-8a6b-4df2-a1a8-4bdafe7783d7 tempest-VolumesServicesTestJSON-1985607529 None] Created volume successfully. Sep 16 22:45:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Acquiring lock "cinder-9ce43409-57ae-4730-b7c3-b84bfb967464-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:45:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Lock "cinder-9ce43409-57ae-4730-b7c3-b84bfb967464-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:45:22 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Acquiring lock "cinder-quobyte-9ce43409-57ae-4730-b7c3-b84bfb967464" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:45:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Lock "cinder-quobyte-9ce43409-57ae-4730-b7c3-b84bfb967464" acquired by "delete_volume" :: waited 0.038s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:45:22 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f532ccf4-6170-4276-bcc6-0b030b9b2096]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:45:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ce43409-57ae-4730-b7c3-b84bfb967464 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ce43409-57ae-4730-b7c3-b84bfb967464" returned: 0 in 0.511s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ce43409-57ae-4730-b7c3-b84bfb967464 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ce43409-57ae-4730-b7c3-b84bfb967464" returned: 0 in 0.091s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Lock "cinder-quobyte-9ce43409-57ae-4730-b7c3-b84bfb967464" released by "delete_volume" :: held 0.766s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Created reservations ['5dfcbe13-db87-414f-81f7-4937fbd65487', '5d9ea94e-c451-4dae-88c4-4027c03ff6fd', '9c368abc-8dd2-48b0-8163-684d62bb78f4', '5ef4e554-2d6a-4778-af3d-e799e10ed009'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.081s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:45:23 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Deleted volume successfully. Sep 16 22:45:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-82dbca3d-340f-484b-9a97-841b8cf52b5f tempest-VolumesServicesTestJSON-1985607529 None] Lock "cinder-9ce43409-57ae-4730-b7c3-b84bfb967464-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:45:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-6f27eea4-ca6b-40d5-b72d-cf66fe3d2788 req-37e8868e-a0c5-46b8-908c-5ea6e4c736a8 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-6f27eea4-ca6b-40d5-b72d-cf66fe3d2788 req-37e8868e-a0c5-46b8-908c-5ea6e4c736a8 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:26 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9383ba-807f-41cf-9da5-f15ffc849149]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:45:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-6f27eea4-ca6b-40d5-b72d-cf66fe3d2788 req-37e8868e-a0c5-46b8-908c-5ea6e4c736a8 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-6f27eea4-ca6b-40d5-b72d-cf66fe3d2788 req-37e8868e-a0c5-46b8-908c-5ea6e4c736a8 tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8" returned: 0 in 0.627s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-6f27eea4-ca6b-40d5-b72d-cf66fe3d2788 req-37e8868e-a0c5-46b8-908c-5ea6e4c736a8 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.706s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-6f27eea4-ca6b-40d5-b72d-cf66fe3d2788 req-37e8868e-a0c5-46b8-908c-5ea6e4c736a8 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0eaa8e0-1426-47fd-87ca-4dd19412b53f', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:45:27 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-6f27eea4-ca6b-40d5-b72d-cf66fe3d2788 req-37e8868e-a0c5-46b8-908c-5ea6e4c736a8 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:27 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-6f27eea4-ca6b-40d5-b72d-cf66fe3d2788 req-37e8868e-a0c5-46b8-908c-5ea6e4c736a8 tempest-TestServerVolumeAttachmentScenario-1607189705 None] attachment_update completed successfully. Sep 16 22:45:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:45:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:45:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:45:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.150s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:45:36 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Flow 'volume_create_manager' (4a04a293-2bd8-402b-b991-4aa24f504820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4870ba-bfcf-4338-ad57-f54cd610de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4870ba-bfcf-4338-ad57-f54cd610de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-497643873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e466b4dd-8899-469d-a743-5f5b16157a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbeaf85f70842338afc221ef028ac15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:45:36Z,use_quota=True,user_id='9ff1d1740f194bcf8bfafcf2ecf6f9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358d6afd-a24b-404c-98cc-6577c09a1677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358d6afd-a24b-404c-98cc-6577c09a1677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930e40a8-4bbe-4511-a0e8-47b35529e488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930e40a8-4bbe-4511-a0e8-47b35529e488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e466b4dd-8899-469d-a743-5f5b16157a88', 'volume_name': 'volume-e466b4dd-8899-469d-a743-5f5b16157a88', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d2f8ee-102e-45fe-8a07-23799d941637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d2f8ee-102e-45fe-8a07-23799d941637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0655a768-c32d-45c9-92db-a5a4637180c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:36 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Volume e466b4dd-8899-469d-a743-5f5b16157a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e466b4dd-8899-469d-a743-5f5b16157a88', 'volume_size': 1} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-497643873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e466b4dd-8899-469d-a743-5f5b16157a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbeaf85f70842338afc221ef028ac15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:45:36Z,use_quota=True,user_id='9ff1d1740f194bcf8bfafcf2ecf6f9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Creating volume e466b4dd-8899-469d-a743-5f5b16157a88 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:45:36 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:45:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:36 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=62, name=volume-e466b4dd-8899-469d-a743-5f5b16157a88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88 1073741824" returned: 0 in 0.449s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:37 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Flow 'volume_create_manager' (ce3d7c66-4262-4db4-beac-545cfaa0a3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b8e2a1-604c-4ea5-9316-d5ee5a8e144a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88" returned: 0 in 0.453s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] <== create_volume: return (933ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b8e2a1-604c-4ea5-9316-d5ee5a8e144a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1918826617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17440d77-82a1-4bbb-9e17-5ffe3658f36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9210752066de4c5ca6d2c08c5cc7975f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:45:36Z,use_quota=True,user_id='da0815644dee474fb196377709ee5a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79d0549-9695-40e4-87cf-165f04b43dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79d0549-9695-40e4-87cf-165f04b43dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcc2354-3272-44d1-845f-237ca3647525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcc2354-3272-44d1-845f-237ca3647525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17440d77-82a1-4bbb-9e17-5ffe3658f36f', 'volume_name': 'volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78183be-a2ee-4051-b97f-4702200fd721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78183be-a2ee-4051-b97f-4702200fd721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269707d4-396d-44fa-a446-de84e495ffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:37 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume 17440d77-82a1-4bbb-9e17-5ffe3658f36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f', 'volume_size': 1} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1918826617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17440d77-82a1-4bbb-9e17-5ffe3658f36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9210752066de4c5ca6d2c08c5cc7975f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:45:36Z,use_quota=True,user_id='da0815644dee474fb196377709ee5a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Creating volume 17440d77-82a1-4bbb-9e17-5ffe3658f36f {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:45:37 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:37 devstack quobyte-client[83246]: System call of process 92812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:45:37 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=63, name=volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0655a768-c32d-45c9-92db-a5a4637180c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e466b4dd-8899-469d-a743-5f5b16157a88', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddf89fb-08c4-4267-a2a5-fd2fa2130600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:38 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Volume volume-e466b4dd-8899-469d-a743-5f5b16157a88 (e466b4dd-8899-469d-a743-5f5b16157a88): created successfully Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddf89fb-08c4-4267-a2a5-fd2fa2130600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Flow 'volume_create_manager' (4a04a293-2bd8-402b-b991-4aa24f504820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f 1073741824" returned: 0 in 0.440s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:38 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-1bfb8309-6f1e-40ed-b2ff-b132cabc7d41 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Created volume successfully. Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f" returned: 0 in 0.305s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] <== create_volume: return (769ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269707d4-396d-44fa-a446-de84e495ffdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e42993a-48fb-4d01-920a-8125cc5f194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:45:38 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f (17440d77-82a1-4bbb-9e17-5ffe3658f36f): created successfully Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e42993a-48fb-4d01-920a-8125cc5f194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:45:38 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Flow 'volume_create_manager' (ce3d7c66-4262-4db4-beac-545cfaa0a3e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:45:38 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-31dc3546-27c9-48b9-8a0e-526f415c3e36 tempest-AttachVolumeShelveTestJSON-1626356156 None] Created volume successfully. Sep 16 22:45:39 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Creating offline snapshot 5099d1eb-5d4a-488d-91f4-2c1f05ffa193 of volume e466b4dd-8899-469d-a743-5f5b16157a88 {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:45:39 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0395e73c-233f-45ce-913a-d468e3064900]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:45:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88" returned: 0 in 0.439s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:39 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=64, name=volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193 1G" returned: 0 in 0.259s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e466b4dd-8899-469d-a743-5f5b16157a88 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "qemu-img rebase -u -b volume-e466b4dd-8899-469d-a743-5f5b16157a88 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193" returned: 0 in 0.147s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193" returned: 0 in 0.116s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193" returned: 0 in 0.120s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.info" returned: 0 in 0.134s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.info" returned: 0 in 0.120s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.738s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:41 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-cf1fd796-baed-487a-844f-e84f6829bae5 tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Create snapshot completed successfully Sep 16 22:45:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-6c9b355b-6ea7-4a14-853e-20881a579944 req-d7c6c768-dc1c-48ce-95af-a5e544793ed0 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-6c9b355b-6ea7-4a14-853e-20881a579944 req-d7c6c768-dc1c-48ce-95af-a5e544793ed0 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:43 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b27268-ef26-4f41-affe-bf66409150fd]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:45:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-6c9b355b-6ea7-4a14-853e-20881a579944 req-d7c6c768-dc1c-48ce-95af-a5e544793ed0 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Acquiring lock "cinder-5099d1eb-5d4a-488d-91f4-2c1f05ffa193-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "cinder-5099d1eb-5d4a-488d-91f4-2c1f05ffa193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.153s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:45:44 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Acquiring lock "cinder-quobyte-e466b4dd-8899-469d-a743-5f5b16157a88" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "cinder-quobyte-e466b4dd-8899-469d-a743-5f5b16157a88" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Acquiring lock "cinder-quobyte-5099d1eb-5d4a-488d-91f4-2c1f05ffa193" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "cinder-quobyte-5099d1eb-5d4a-488d-91f4-2c1f05ffa193" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Deleting offline snapshot 5099d1eb-5d4a-488d-91f4-2c1f05ffa193 of volume e466b4dd-8899-469d-a743-5f5b16157a88 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] snapshot_file for this snap is: volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-6c9b355b-6ea7-4a14-853e-20881a579944 req-d7c6c768-dc1c-48ce-95af-a5e544793ed0 tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7" returned: 0 in 1.722s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-6c9b355b-6ea7-4a14-853e-20881a579944 req-d7c6c768-dc1c-48ce-95af-a5e544793ed0 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.872s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c017d7-fcdd-4124-a22a-ff419795f93c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:45:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:45 devstack quobyte-client[83246]: System call of process 92939 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:45:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193" returned: 0 in 0.629s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e466b4dd-8899-469d-a743-5f5b16157a88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:45:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-6c9b355b-6ea7-4a14-853e-20881a579944 req-d7c6c768-dc1c-48ce-95af-a5e544793ed0 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd23b781-3a8f-43f1-8136-d63e80963a7f', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:45:45 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-6c9b355b-6ea7-4a14-853e-20881a579944 req-d7c6c768-dc1c-48ce-95af-a5e544793ed0 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:45 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0cfef9-4a3a-47c7-84cb-d5c80b0c2798]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:45:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:46 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-6c9b355b-6ea7-4a14-853e-20881a579944 req-d7c6c768-dc1c-48ce-95af-a5e544793ed0 tempest-TestServerVolumeAttachmentScenario-1607189705 None] attachment_update completed successfully. Sep 16 22:45:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88" returned: 0 in 0.592s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:46 devstack quobyte-client[83246]: System call of process 92945 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:45:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193" returned: 0 in 0.311s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88.5099d1eb-5d4a-488d-91f4-2c1f05ffa193" returned: 0 in 0.184s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "cinder-quobyte-5099d1eb-5d4a-488d-91f4-2c1f05ffa193" released by "_delete_snapshot" :: held 2.269s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:45:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "cinder-quobyte-e466b4dd-8899-469d-a743-5f5b16157a88" released by "delete_snapshot" :: held 2.358s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:45:47 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Created reservations ['997f89f0-2aa9-4fd5-bab8-fb0dbc755888', 'b7a2cf1b-1bc1-453a-b1e1-aee84e216da2', '7b9995d7-f8e0-4932-975d-93fdcdbc3944', 'ecd55d05-f570-4cf5-a20a-9b36f76ee76a'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:45:47 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Delete snapshot completed successfully. Sep 16 22:45:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d216e05-720b-48ee-b900-03afdc2a884b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "cinder-5099d1eb-5d4a-488d-91f4-2c1f05ffa193-delete_snapshot" released by "delete_snapshot" :: held 2.934s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:45:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Acquiring lock "cinder-e466b4dd-8899-469d-a743-5f5b16157a88-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:45:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "cinder-e466b4dd-8899-469d-a743-5f5b16157a88-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:45:48 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:45:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Acquiring lock "cinder-quobyte-e466b4dd-8899-469d-a743-5f5b16157a88" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:45:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "cinder-quobyte-e466b4dd-8899-469d-a743-5f5b16157a88" acquired by "delete_volume" :: waited 0.025s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:45:48 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27f0ddc-cd13-49f0-9fd2-fb2795df1317]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:45:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88" returned: 0 in 0.676s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e466b4dd-8899-469d-a743-5f5b16157a88" returned: 0 in 0.117s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "cinder-quobyte-e466b4dd-8899-469d-a743-5f5b16157a88" released by "delete_volume" :: held 1.041s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:45:49 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Created reservations ['1738ff59-9419-432e-88c3-0b7aafc792da', '469a1796-c0ca-489c-9e74-b8898f974883', '481df027-73d2-4384-9c0c-17b439fa65dc', 'c90d7573-0b1e-489d-8819-fd132ab89ad8'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:45:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:45:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:45:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:45:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:45:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:45:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:45:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.092s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:45:49 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:45:49 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Deleted volume successfully. Sep 16 22:45:50 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-778110ec-abd4-4a0c-8f9c-2c0385838d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-144598399 None] Lock "cinder-e466b4dd-8899-469d-a743-5f5b16157a88-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:45:59 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=46,cinder:UPDATE=45,cinder:INSERT=10,cinder:DELETE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:45:59 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=48,cinder:SELECT=41,cinder:DELETE=5,cinder:INSERT=6 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:46:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Flow 'volume_create_manager' (5f8e9e2b-8251-4bd3-888f-cc8ac88b25e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4680b621-2ec6-4652-bf41-2cd652d5e828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4680b621-2ec6-4652-bf41-2cd652d5e828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-365500402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e44a9a6-519f-47e9-8c48-69bcc52dea3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f0acbb1fa14a0ab9dd3f04c7378e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:02Z,use_quota=True,user_id='b24e488d0f294f048fd60aef738e5ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbfd2e8-c41d-4b56-942a-e2148e36a46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbfd2e8-c41d-4b56-942a-e2148e36a46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dba687b-f4fc-4c25-9060-b555e68d6ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dba687b-f4fc-4c25-9060-b555e68d6ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e44a9a6-519f-47e9-8c48-69bcc52dea3f', 'volume_name': 'volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e7ab9c-9f6a-4a40-a564-b0dde5bb1cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e7ab9c-9f6a-4a40-a564-b0dde5bb1cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7fdb9b-750b-4732-928d-e45c4fad8651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:02 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Volume 1e44a9a6-519f-47e9-8c48-69bcc52dea3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f', 'volume_size': 1} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-365500402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e44a9a6-519f-47e9-8c48-69bcc52dea3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f0acbb1fa14a0ab9dd3f04c7378e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:02Z,use_quota=True,user_id='b24e488d0f294f048fd60aef738e5ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Creating volume 1e44a9a6-519f-47e9-8c48-69bcc52dea3f {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:46:02 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:02 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=66, name=volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f 1073741824" returned: 0 in 0.317s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] <== create_volume: return (474ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.488s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7fdb9b-750b-4732-928d-e45c4fad8651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4d691e-63c0-4eb3-82ac-de8499e19803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:03 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Volume volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f (1e44a9a6-519f-47e9-8c48-69bcc52dea3f): created successfully Sep 16 22:46:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4d691e-63c0-4eb3-82ac-de8499e19803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Flow 'volume_create_manager' (5f8e9e2b-8251-4bd3-888f-cc8ac88b25e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:03 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5fdb2e89-e667-4f7f-95bc-2d4a588f1cca tempest-VolumesListAdminTestJSON-321054630 None] Created volume successfully. Sep 16 22:46:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-ae4a243d-915c-4c9d-8e47-0f660440f100 req-640d604f-f153-4e69-b027-da590bfd7b80 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-ae4a243d-915c-4c9d-8e47-0f660440f100 req-640d604f-f153-4e69-b027-da590bfd7b80 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:04 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[484a2a81-19ed-4f1e-8704-df360bf2921d]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-ae4a243d-915c-4c9d-8e47-0f660440f100 req-640d604f-f153-4e69-b027-da590bfd7b80 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-ae4a243d-915c-4c9d-8e47-0f660440f100 req-640d604f-f153-4e69-b027-da590bfd7b80 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f" returned: 0 in 0.759s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-ae4a243d-915c-4c9d-8e47-0f660440f100 req-640d604f-f153-4e69-b027-da590bfd7b80 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.806s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:05 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Flow 'volume_create_manager' (807c0bc2-0019-42be-b857-e4eeb02712e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecfc3e4-aeaf-4b04-abc1-24bd3ad5f414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecfc3e4-aeaf-4b04-abc1-24bd3ad5f414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1583701117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b43f12-13d3-45f7-9a6d-010d6c61a85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f0acbb1fa14a0ab9dd3f04c7378e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:05Z,use_quota=True,user_id='b24e488d0f294f048fd60aef738e5ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9a8ff7-b7bb-4482-95da-e1c9dd6116c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9a8ff7-b7bb-4482-95da-e1c9dd6116c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce59004-96a3-4ede-90c7-95b99f1e2e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce59004-96a3-4ede-90c7-95b99f1e2e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b43f12-13d3-45f7-9a6d-010d6c61a85f', 'volume_name': 'volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fc1a9c-16d9-4be6-8164-d5d364b2872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45fc1a9c-16d9-4be6-8164-d5d364b2872c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0db5f66-861f-4594-b62b-57f32f206122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:05 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Volume 91b43f12-13d3-45f7-9a6d-010d6c61a85f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f', 'volume_size': 1} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1583701117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b43f12-13d3-45f7-9a6d-010d6c61a85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f0acbb1fa14a0ab9dd3f04c7378e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:05Z,use_quota=True,user_id='b24e488d0f294f048fd60aef738e5ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Creating volume 91b43f12-13d3-45f7-9a6d-010d6c61a85f {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:46:05 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:05 devstack quobyte-client[83246]: System call of process 93022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:46:05 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=67, name=volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:46:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-ae4a243d-915c-4c9d-8e47-0f660440f100 req-640d604f-f153-4e69-b027-da590bfd7b80 tempest-AttachVolumeShelveTestJSON-1626356156 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9feffea9-da7b-4a02-80eb-a32199165b5e', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:46:05 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-ae4a243d-915c-4c9d-8e47-0f660440f100 req-640d604f-f153-4e69-b027-da590bfd7b80 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f 1073741824" returned: 0 in 0.677s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f" returned: 0 in 0.467s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] <== create_volume: return (1181ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:46:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0db5f66-861f-4594-b62b-57f32f206122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570a1054-f3dd-4053-a34d-e80d11854d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:06 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-ae4a243d-915c-4c9d-8e47-0f660440f100 req-640d604f-f153-4e69-b027-da590bfd7b80 tempest-AttachVolumeShelveTestJSON-1626356156 None] attachment_update completed successfully. Sep 16 22:46:06 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Volume volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f (91b43f12-13d3-45f7-9a6d-010d6c61a85f): created successfully Sep 16 22:46:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570a1054-f3dd-4053-a34d-e80d11854d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Flow 'volume_create_manager' (807c0bc2-0019-42be-b857-e4eeb02712e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:06 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-1733a239-bf5b-42c9-a99c-06add5086493 tempest-VolumesListAdminTestJSON-321054630 None] Created volume successfully. Sep 16 22:46:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Flow 'volume_create_manager' (0bbf9e7c-9cd7-45c9-aa1f-d20a86be21da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969953dd-135d-453a-bdd5-bb4c8fbf4dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969953dd-135d-453a-bdd5-bb4c8fbf4dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1885134334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d619d65b-303b-4c19-bf7e-e9ecf8d10f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f0acbb1fa14a0ab9dd3f04c7378e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:08Z,use_quota=True,user_id='b24e488d0f294f048fd60aef738e5ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ce56f7-2a1e-4823-b480-4650e33b7577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ce56f7-2a1e-4823-b480-4650e33b7577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a949f136-5374-4328-9603-f34b35f77fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a949f136-5374-4328-9603-f34b35f77fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd619d65b-303b-4c19-bf7e-e9ecf8d10f68', 'volume_name': 'volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02645e34-b938-44ce-a4c8-8f4938e9af1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02645e34-b938-44ce-a4c8-8f4938e9af1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278ddacf-6d7d-4033-ac00-87c8be201016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:07 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Volume d619d65b-303b-4c19-bf7e-e9ecf8d10f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68', 'volume_size': 1} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1885134334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d619d65b-303b-4c19-bf7e-e9ecf8d10f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f0acbb1fa14a0ab9dd3f04c7378e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:08Z,use_quota=True,user_id='b24e488d0f294f048fd60aef738e5ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Creating volume d619d65b-303b-4c19-bf7e-e9ecf8d10f68 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:46:07 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:46:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:08 devstack quobyte-client[83246]: System call of process 93029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:46:08 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=68, name=volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:46:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68 1073741824" returned: 0 in 0.342s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68" returned: 0 in 0.081s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] <== create_volume: return (486ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:46:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.499s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278ddacf-6d7d-4033-ac00-87c8be201016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa58955d-05a7-4821-a5bf-ba9a1d8b7a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:08 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Volume volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68 (d619d65b-303b-4c19-bf7e-e9ecf8d10f68): created successfully Sep 16 22:46:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa58955d-05a7-4821-a5bf-ba9a1d8b7a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Flow 'volume_create_manager' (0bbf9e7c-9cd7-45c9-aa1f-d20a86be21da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:08 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6a4ac4d2-9384-4247-bd7f-670865f89308 tempest-VolumesListAdminTestJSON-321054630 None] Created volume successfully. Sep 16 22:46:09 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Flow 'volume_create_manager' (785ff638-fa6e-4644-9958-67dd1b84c425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4371497f-ccc8-4c2e-b548-ee8d7af1d673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4371497f-ccc8-4c2e-b548-ee8d7af1d673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e3b116-372a-4e17-a6b4-7ce6051bd1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd95d8476344d52b2492ca1c7c8439d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:09Z,use_quota=True,user_id='fa98f5eb07d14d4880755b848f9b908b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2386da94-ffa1-4c47-ae3b-67fc57679f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2386da94-ffa1-4c47-ae3b-67fc57679f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e0d9ba-d769-4b75-bc5b-7f2bcecae042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e0d9ba-d769-4b75-bc5b-7f2bcecae042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e3b116-372a-4e17-a6b4-7ce6051bd1bf', 'volume_name': 'volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b2a28d-6788-49b7-9137-7e4df2d1e01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b2a28d-6788-49b7-9137-7e4df2d1e01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb72a887-d80e-4c88-9d2c-81f2221fa69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:09 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Volume 88e3b116-372a-4e17-a6b4-7ce6051bd1bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf', 'volume_size': 1} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e3b116-372a-4e17-a6b4-7ce6051bd1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd95d8476344d52b2492ca1c7c8439d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:09Z,use_quota=True,user_id='fa98f5eb07d14d4880755b848f9b908b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Creating volume 88e3b116-372a-4e17-a6b4-7ce6051bd1bf {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:46:09 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:09 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=69, name=volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf 1073741824" returned: 0 in 0.316s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] <== create_volume: return (475ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:46:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.487s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb72a887-d80e-4c88-9d2c-81f2221fa69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8636a9b8-fc7c-49ca-9b97-d091ca49cc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:10 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Volume volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf (88e3b116-372a-4e17-a6b4-7ce6051bd1bf): created successfully Sep 16 22:46:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8636a9b8-fc7c-49ca-9b97-d091ca49cc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Flow 'volume_create_manager' (785ff638-fa6e-4644-9958-67dd1b84c425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:10 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7100fdc1-4d5d-4591-9c65-933d261c4c2f tempest-VolumesListAdminTestJSON-1899096010 None] Created volume successfully. Sep 16 22:46:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Acquiring lock "cinder-88e3b116-372a-4e17-a6b4-7ce6051bd1bf-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Lock "cinder-88e3b116-372a-4e17-a6b4-7ce6051bd1bf-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "cinder-d619d65b-303b-4c19-bf7e-e9ecf8d10f68-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-d619d65b-303b-4c19-bf7e-e9ecf8d10f68-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Acquiring lock "cinder-quobyte-88e3b116-372a-4e17-a6b4-7ce6051bd1bf" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "cinder-quobyte-d619d65b-303b-4c19-bf7e-e9ecf8d10f68" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Lock "cinder-quobyte-88e3b116-372a-4e17-a6b4-7ce6051bd1bf" acquired by "delete_volume" :: waited 0.036s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:12 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93ce3da-d07f-444f-9f74-7837707d8198]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-quobyte-d619d65b-303b-4c19-bf7e-e9ecf8d10f68" acquired by "delete_volume" :: waited 0.141s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:12 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25525cc-54a5-4c9c-9e74-9b6f7b50e97b]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf" returned: 0 in 0.533s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-88e3b116-372a-4e17-a6b4-7ce6051bd1bf" returned: 0 in 0.141s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Lock "cinder-quobyte-88e3b116-372a-4e17-a6b4-7ce6051bd1bf" released by "delete_volume" :: held 0.880s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68" returned: 0 in 0.829s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d619d65b-303b-4c19-bf7e-e9ecf8d10f68" returned: 0 in 0.261s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-quobyte-d619d65b-303b-4c19-bf7e-e9ecf8d10f68" released by "delete_volume" :: held 1.279s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Created reservations ['6199b14a-e391-4194-9e4d-ae39ce10c4e4', '1a97ac93-d9cb-460f-9fce-6916488b46c0', '7d3de0ce-a569-49d6-a625-9a5209341117', 'e75f8bf4-ee6e-4e19-9c54-a271b20ec623'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Created reservations ['25d4fc90-94ab-4b3f-a870-320668f6faa5', '1649b6ea-13a2-4961-bc77-c314ad2798d6', '63fdbac2-4a22-4fd9-9e4f-63b1dc5827dd', '989eb8e4-2bfd-4c62-9a65-43be55532296'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.529s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "cinder-91b43f12-13d3-45f7-9a6d-010d6c61a85f-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:14 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Deleted volume successfully. Sep 16 22:46:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2e5b3376-b60e-4f7a-9d30-4c9ddb7382ed req-e843c296-b136-4106-88cd-e0ec8b08686d tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.733s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-91b43f12-13d3-45f7-9a6d-010d6c61a85f-delete_volume" acquired by "delete_volume" :: waited 0.307s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:46:14 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Deleted volume successfully. Sep 16 22:46:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2e5b3376-b60e-4f7a-9d30-4c9ddb7382ed req-e843c296-b136-4106-88cd-e0ec8b08686d tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:14 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-2e5b3376-b60e-4f7a-9d30-4c9ddb7382ed req-e843c296-b136-4106-88cd-e0ec8b08686d tempest-TestServerVolumeAttachmentScenario-1607189705 None] Terminate volume connection completed successfully. Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-2e5b3376-b60e-4f7a-9d30-4c9ddb7382ed req-e843c296-b136-4106-88cd-e0ec8b08686d tempest-TestServerVolumeAttachmentScenario-1607189705 None] Deleting attachment fd23b781-3a8f-43f1-8136-d63e80963a7f. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b42d70bf-a76b-48d2-819a-0f05e1e8a8a4 tempest-VolumesListAdminTestJSON-1899096010 None] Lock "cinder-88e3b116-372a-4e17-a6b4-7ce6051bd1bf-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "cinder-quobyte-91b43f12-13d3-45f7-9a6d-010d6c61a85f" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-89da72ed-c8e1-4572-85b8-8b6210d1b891 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-d619d65b-303b-4c19-bf7e-e9ecf8d10f68-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-quobyte-91b43f12-13d3-45f7-9a6d-010d6c61a85f" acquired by "delete_volume" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc7ab68-6e24-4624-bbd0-e9655b059025]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f" returned: 0 in 0.533s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-91b43f12-13d3-45f7-9a6d-010d6c61a85f" returned: 0 in 0.144s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-quobyte-91b43f12-13d3-45f7-9a6d-010d6c61a85f" released by "delete_volume" :: held 0.866s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Created reservations ['f70cbfdb-dbc7-4e0c-9843-363d4d13bc07', '705351ac-867a-46e6-ad2b-32169e0f1898', '6cbceff7-eb72-453d-b0d3-9fc0ec74332b', 'dc013d87-0f23-4cf6-a0a6-e67a6bb6502b'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.125s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:46:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Deleted volume successfully. Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a95c2eaf-5b50-41bc-a2e1-0680ed63a027 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-91b43f12-13d3-45f7-9a6d-010d6c61a85f-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "cinder-1e44a9a6-519f-47e9-8c48-69bcc52dea3f-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-1e44a9a6-519f-47e9-8c48-69bcc52dea3f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:17 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "cinder-quobyte-1e44a9a6-519f-47e9-8c48-69bcc52dea3f" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-quobyte-1e44a9a6-519f-47e9-8c48-69bcc52dea3f" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:17 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede9bf38-03e1-42c3-968d-7522b4faa627]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f" returned: 0 in 0.416s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1e44a9a6-519f-47e9-8c48-69bcc52dea3f" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-quobyte-1e44a9a6-519f-47e9-8c48-69bcc52dea3f" released by "delete_volume" :: held 0.665s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:18 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Created reservations ['2ef50789-1aca-4777-9610-c3f2e4b4fd3c', '8ad28d2b-01cb-47ae-8ff8-05dee7f9df35', '0c0b58b8-3863-4851-893f-a64bab6016ac', 'f3ae157b-9669-4758-9725-b25814a81b20'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:46:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.164s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:18 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:46:18 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Deleted volume successfully. Sep 16 22:46:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40073259-1f32-47e0-a3ff-26f3398c3324 tempest-VolumesListAdminTestJSON-321054630 None] Lock "cinder-1e44a9a6-519f-47e9-8c48-69bcc52dea3f-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:28 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Flow 'volume_create_manager' (79dbde70-4794-4b34-ab7a-4adbc4cc37c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd4673f-6a8e-4e06-bb4f-2d0de84c1801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd4673f-6a8e-4e06-bb4f-2d0de84c1801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-866440159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb243ce-08e9-41cc-ad56-f2980d10d990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7114ba3d5a3430992fbd09bb21ff1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:28Z,use_quota=True,user_id='391ffb483fe346a682fb5db27e8e84d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3546f1c6-8350-49af-b9bd-f5084bad9103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3546f1c6-8350-49af-b9bd-f5084bad9103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083cdd39-91bc-4aee-8f8b-f04e2f02ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.170s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083cdd39-91bc-4aee-8f8b-f04e2f02ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2eb243ce-08e9-41cc-ad56-f2980d10d990', 'volume_name': 'volume-2eb243ce-08e9-41cc-ad56-f2980d10d990', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313f7770-f38c-4cb0-8d29-9e5fb5c6ee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313f7770-f38c-4cb0-8d29-9e5fb5c6ee6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784c29c1-c4d6-4a49-aa91-a739343458a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:28 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Volume 2eb243ce-08e9-41cc-ad56-f2980d10d990: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2eb243ce-08e9-41cc-ad56-f2980d10d990', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 22:46:28 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Cloning 2eb243ce-08e9-41cc-ad56-f2980d10d990 from image 99ab3cef-3584-47a5-9dcc-19749e64ee70 at location (None, None). {{(pid=83223) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}} Sep 16 22:46:29 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 22:46:29 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Image download 20.69 MB at 20.69 MB/s Sep 16 22:46:29 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d65a31-e47e-4c82-a8cc-1203596d69f5]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:29 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD Sep 16 22:46:29 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:46:31 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Sep 16 22:46:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD" returned: 0 in 2.049s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:31 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Temporary image 99ab3cef-3584-47a5-9dcc-19749e64ee70 is fetched for user 391ffb483fe346a682fb5db27e8e84d7. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 22:46:31 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede78657-e809-4071-9dad-18c0a4032727]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:32 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD Sep 16 22:46:32 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:46:34 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD" returned: 0 in 2.435s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-866440159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb243ce-08e9-41cc-ad56-f2980d10d990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7114ba3d5a3430992fbd09bb21ff1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:28Z,use_quota=True,user_id='391ffb483fe346a682fb5db27e8e84d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Creating volume 2eb243ce-08e9-41cc-ad56-f2980d10d990 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.094s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:46:34 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:46:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:34 devstack quobyte-client[83246]: System call of process 93148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:46:34 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=70, name=volume-2eb243ce-08e9-41cc-ad56-f2980d10d990, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:46:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 1073741824" returned: 0 in 0.715s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990" returned: 0 in 0.261s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] <== create_volume: return (1317ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:46:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:36 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Attempting download of 99ab3cef-3584-47a5-9dcc-19749e64ee70 ((None, None)) to volume 2eb243ce-08e9-41cc-ad56-f2980d10d990. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 22:46:36 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac04ed7-836a-497a-82a0-d83e96ee34f7]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_zvkiwzj1 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_zvkiwzj1" returned: 0 in 0.869s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_zvkiwzj1 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_zvkiwzj1" returned: 1 in 0.639s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_zvkiwzj1' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:46:38 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb1b773-bd87-4e3c-baf7-30c70e35bba2]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:39 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] 99ab3cef-3584-47a5-9dcc-19749e64ee70 was qcow2, converting to raw {{(pid=83223) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 22:46:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:39 devstack quobyte-client[83246]: System call of process 93206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:46:39 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=70, name=volume-2eb243ce-08e9-41cc-ad56-f2980d10d990, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:46:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990" returned: 0 in 0.935s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:40 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_4ynqyelkdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 22:46:40 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Converted 112.00 MB image at 112.00 MB/s Sep 16 22:46:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:40 devstack quobyte-client[83246]: System call of process 93217 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:46:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 1G" returned: 0 in 0.232s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:40 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce17df0-9d85-46ce-ae8d-031563d27ef5]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:40 devstack quobyte-client[83246]: System call of process 93220 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:46:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990" returned: 0 in 0.519s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:41 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-ab3de416-e483-498a-889b-2c86e3842f97 req-3c001409-0905-4a11-8450-5fa0c5a82727 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:41 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-ab3de416-e483-498a-889b-2c86e3842f97 req-3c001409-0905-4a11-8450-5fa0c5a82727 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:41 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-ab3de416-e483-498a-889b-2c86e3842f97 req-3c001409-0905-4a11-8450-5fa0c5a82727 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Terminate volume connection completed successfully. Sep 16 22:46:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-ab3de416-e483-498a-889b-2c86e3842f97 req-3c001409-0905-4a11-8450-5fa0c5a82727 tempest-TestServerVolumeAttachmentScenario-1607189705 None] Deleting attachment d0eaa8e0-1426-47fd-87ca-4dd19412b53f. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:46:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990" returned: 1 in 0.644s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:46:41 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Downloaded image 99ab3cef-3584-47a5-9dcc-19749e64ee70 ((None, None)) to volume 2eb243ce-08e9-41cc-ad56-f2980d10d990 successfully. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 22:46:41 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Temporary image 99ab3cef-3584-47a5-9dcc-19749e64ee70 for user 391ffb483fe346a682fb5db27e8e84d7 is deleted. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 22:46:41 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Marking volume 2eb243ce-08e9-41cc-ad56-f2980d10d990 as bootable. {{(pid=83223) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 22:46:41 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Copying metadata from image 99ab3cef-3584-47a5-9dcc-19749e64ee70 to 2eb243ce-08e9-41cc-ad56-f2980d10d990. {{(pid=83223) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 22:46:41 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Creating volume glance metadata for volume 2eb243ce-08e9-41cc-ad56-f2980d10d990 backed by image 99ab3cef-3584-47a5-9dcc-19749e64ee70 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83223) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 22:46:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784c29c1-c4d6-4a49-aa91-a739343458a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb243ce-08e9-41cc-ad56-f2980d10d990', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780861e2-5a01-4584-aa61-123675fec957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:42 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Volume volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 (2eb243ce-08e9-41cc-ad56-f2980d10d990): created successfully Sep 16 22:46:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780861e2-5a01-4584-aa61-123675fec957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Flow 'volume_create_manager' (79dbde70-4794-4b34-ab7a-4adbc4cc37c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:42 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7229a4d8-64e7-4e6c-8e76-25027a00ebe3 tempest-VolumesImageMetadata-2023262940 None] Created volume successfully. Sep 16 22:46:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Acquiring lock "cinder-2eb243ce-08e9-41cc-ad56-f2980d10d990-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Lock "cinder-2eb243ce-08e9-41cc-ad56-f2980d10d990-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:43 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Acquiring lock "cinder-quobyte-2eb243ce-08e9-41cc-ad56-f2980d10d990" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Lock "cinder-quobyte-2eb243ce-08e9-41cc-ad56-f2980d10d990" acquired by "delete_volume" :: waited 0.013s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:43 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ea2743-2f21-4e67-817d-b4f34680414d]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990" returned: 0 in 0.495s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990" returned: 1 in 1.597s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:46:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2eb243ce-08e9-41cc-ad56-f2980d10d990" returned: 0 in 0.337s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Lock "cinder-quobyte-2eb243ce-08e9-41cc-ad56-f2980d10d990" released by "delete_volume" :: held 3.226s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:47 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Created reservations ['f7e4fad6-c089-46e7-be31-68dddd77bdcf', 'e38fdafc-3ccb-4ae2-9e84-c6acb9cca674', '64484b37-8ac6-4d0b-b21f-4ec5adc33038', '9c809433-93d9-4d53-a289-e63d4cdd55dd'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:46:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.089s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:47 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:46:47 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Deleted volume successfully. Sep 16 22:46:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3c3a67ee-e84f-4ce1-9331-dc3190d36268 tempest-VolumesImageMetadata-2023262940 None] Lock "cinder-2eb243ce-08e9-41cc-ad56-f2980d10d990-delete_volume" released by "delete_volume" :: held 4.425s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "cinder-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "cinder-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:54 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Flow 'volume_create_manager' (511adcec-e11a-482e-b5ba-cb6c8a07650e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46cc8c3-c179-4ee2-bf9f-2100de656edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46cc8c3-c179-4ee2-bf9f-2100de656edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1767818888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41f9c78-dd99-4900-b6bc-f3b4264f79de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59363d0c29c249699e56a42295bea736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:54Z,use_quota=True,user_id='cd237ef5f21447b09406d6871f423533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c08dc03-19a5-473a-b18d-3900375e36ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c08dc03-19a5-473a-b18d-3900375e36ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9069be89-d0e3-4b14-a456-458533d92bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9069be89-d0e3-4b14-a456-458533d92bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41f9c78-dd99-4900-b6bc-f3b4264f79de', 'volume_name': 'volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be5f80-5bb6-4d34-bfc8-d1a8abedd379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be5f80-5bb6-4d34-bfc8-d1a8abedd379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c35b22d-9581-454b-bcc6-656b5c8f5705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:54 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Volume b41f9c78-dd99-4900-b6bc-f3b4264f79de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de', 'volume_size': 1} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1767818888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41f9c78-dd99-4900-b6bc-f3b4264f79de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59363d0c29c249699e56a42295bea736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:46:54Z,use_quota=True,user_id='cd237ef5f21447b09406d6871f423533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Creating volume b41f9c78-dd99-4900-b6bc-f3b4264f79de {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:46:54 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:46:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:55 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=71, name=volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:46:55 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "cinder-quobyte-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de 1073741824" returned: 0 in 0.490s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "cinder-quobyte-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7" acquired by "delete_volume" :: waited 0.273s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de" returned: 0 in 0.285s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] <== create_volume: return (805ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:46:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:55 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f1b991-7220-4590-bfe7-ff379da0fb9f]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c35b22d-9581-454b-bcc6-656b5c8f5705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04d2956-07fc-45fe-928c-32bcb52c7159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:46:56 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Volume volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de (b41f9c78-dd99-4900-b6bc-f3b4264f79de): created successfully Sep 16 22:46:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04d2956-07fc-45fe-928c-32bcb52c7159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:46:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Flow 'volume_create_manager' (511adcec-e11a-482e-b5ba-cb6c8a07650e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:46:56 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-cd510c7a-eeba-4d98-8890-834ffbcd93e3 tempest-VolumesTransfersV355Test-1308104571 None] Created volume successfully. Sep 16 22:46:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7" returned: 0 in 0.579s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7" returned: 0 in 0.099s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:56 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "cinder-quobyte-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7" released by "delete_volume" :: held 1.046s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:57 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Created reservations ['ac189fc2-d2d3-4971-bade-17f8ebdc5bc3', 'f11ef989-80d4-4dd9-8b39-3727046f3e70', '9cf33316-371e-480e-9906-9f7cd2415976', 'fe80bdab-53f3-4628-94d9-f37969a2e4ca'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:46:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.105s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:57 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:46:57 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Deleted volume successfully. Sep 16 22:46:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7d589ffd-4b76-49b3-8956-c866f661ae1f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "cinder-33757d8a-9ac0-44bc-be65-9cbae9a2a4d7-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "cinder-63c8ca87-6a82-40fa-9fae-93f5a47e34c8-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:58 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-50b5c2f9-3ca1-48ba-bde0-e71c1f071ca3 tempest-VolumesTransfersV355Test-643001610 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:58 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-50b5c2f9-3ca1-48ba-bde0-e71c1f071ca3 tempest-VolumesTransfersV355Test-643001610 None] Transfer volume completed successfully. Sep 16 22:46:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "cinder-63c8ca87-6a82-40fa-9fae-93f5a47e34c8-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:58 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "cinder-quobyte-63c8ca87-6a82-40fa-9fae-93f5a47e34c8" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "cinder-quobyte-63c8ca87-6a82-40fa-9fae-93f5a47e34c8" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:58 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[adec0182-4b06-4b5e-a30a-52dd177b09ac]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:46:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8" returned: 0 in 0.607s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63c8ca87-6a82-40fa-9fae-93f5a47e34c8" returned: 0 in 0.150s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "cinder-quobyte-63c8ca87-6a82-40fa-9fae-93f5a47e34c8" released by "delete_volume" :: held 0.985s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Acquiring lock "cinder-b41f9c78-dd99-4900-b6bc-f3b4264f79de-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=48,cinder:UPDATE=73,cinder:DELETE=7,cinder:INSERT=13 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Lock "cinder-b41f9c78-dd99-4900-b6bc-f3b4264f79de-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Created reservations ['53de212d-e57e-43a1-b08e-1c5b3e2f49b5', '1b0bf4a8-78da-4ede-a647-989b974b10af', 'b317cbff-a693-4634-9c25-569a76631cea', '6fccf00e-39e1-4cdb-9056-6dcc7450a324'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:46:59 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Acquiring lock "cinder-quobyte-b41f9c78-dd99-4900-b6bc-f3b4264f79de" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Lock "cinder-quobyte-b41f9c78-dd99-4900-b6bc-f3b4264f79de" acquired by "delete_volume" :: waited 0.059s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:46:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:00 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[298c215c-5c4e-44ba-8848-3e35c6bd4a89]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.248s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:00 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Deleted volume successfully. Sep 16 22:47:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a12fb60d-2835-4361-b871-7b32ad23028f tempest-TestServerVolumeAttachmentScenario-1607189705 None] Lock "cinder-63c8ca87-6a82-40fa-9fae-93f5a47e34c8-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:00 devstack quobyte-client[83246]: System call of process 93330 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de" returned: 0 in 0.790s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b41f9c78-dd99-4900-b6bc-f3b4264f79de" returned: 0 in 0.259s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Lock "cinder-quobyte-b41f9c78-dd99-4900-b6bc-f3b4264f79de" released by "delete_volume" :: held 1.359s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:01 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=68,cinder:UPDATE=70,cinder:DELETE=5,cinder:INSERT=28 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:47:01 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Created reservations ['4201fa45-66d4-4730-874a-cad535fbe227', '65553aba-f3d2-4960-ada9-7efd6330c554', '0fe31950-b072-475a-b8ff-dbea2b8fde3e', '025485f2-3b6a-4ed7-a299-8bf06233795c'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.220s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:02 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:02 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Deleted volume successfully. Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-140ddc5b-2930-4b17-a9cc-8b0dfbbb3249 tempest-VolumesTransfersV355Test-1525654051 None] Lock "cinder-b41f9c78-dd99-4900-b6bc-f3b4264f79de-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:03 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Flow 'volume_create_manager' (56f97780-9451-43b7-9410-92f771fe0905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2921e75b-4b56-4609-aff1-6c7b2bc4635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2921e75b-4b56-4609-aff1-6c7b2bc4635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-918348712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7efabf-914d-486a-88ca-d1ff5ddd0601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59363d0c29c249699e56a42295bea736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:03Z,use_quota=True,user_id='cd237ef5f21447b09406d6871f423533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18b18be-2cf3-4060-805a-ffd08c9380a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18b18be-2cf3-4060-805a-ffd08c9380a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6618355f-608d-41ba-bd04-ee5ba126ce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6618355f-608d-41ba-bd04-ee5ba126ce5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec7efabf-914d-486a-88ca-d1ff5ddd0601', 'volume_name': 'volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362f0347-5617-46ca-902d-b2bb8937a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362f0347-5617-46ca-902d-b2bb8937a03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13cf403-fc1f-485f-b193-fd4d35b786d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:03 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Volume ec7efabf-914d-486a-88ca-d1ff5ddd0601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601', 'volume_size': 1} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-918348712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7efabf-914d-486a-88ca-d1ff5ddd0601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59363d0c29c249699e56a42295bea736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:03Z,use_quota=True,user_id='cd237ef5f21447b09406d6871f423533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Creating volume ec7efabf-914d-486a-88ca-d1ff5ddd0601 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:47:03 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:47:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:04 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=72, name=volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601 1073741824" returned: 0 in 0.609s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601" returned: 0 in 0.307s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] <== create_volume: return (1024ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:47:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13cf403-fc1f-485f-b193-fd4d35b786d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467092ed-c350-440d-a8c9-df5d26cb35a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:05 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Volume volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601 (ec7efabf-914d-486a-88ca-d1ff5ddd0601): created successfully Sep 16 22:47:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467092ed-c350-440d-a8c9-df5d26cb35a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Flow 'volume_create_manager' (56f97780-9451-43b7-9410-92f771fe0905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:05 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-2557bdbb-25dc-4803-b735-5aa0b12f852a tempest-VolumesTransfersV355Test-1308104571 None] Created volume successfully. Sep 16 22:47:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Acquiring lock "cinder-ec7efabf-914d-486a-88ca-d1ff5ddd0601-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Lock "cinder-ec7efabf-914d-486a-88ca-d1ff5ddd0601-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Acquiring lock "cinder-quobyte-ec7efabf-914d-486a-88ca-d1ff5ddd0601" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Lock "cinder-quobyte-ec7efabf-914d-486a-88ca-d1ff5ddd0601" acquired by "delete_volume" :: waited 0.023s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:07 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[67caf2d6-6e05-40f9-9a95-3e3d42ecd126]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601" returned: 0 in 0.863s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ec7efabf-914d-486a-88ca-d1ff5ddd0601" returned: 0 in 0.163s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Lock "cinder-quobyte-ec7efabf-914d-486a-88ca-d1ff5ddd0601" released by "delete_volume" :: held 1.437s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:09 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Created reservations ['77d027e5-90b5-41af-977d-5631a1f94ef1', '6ca56ec0-185f-4536-85f8-df26a8f00f4c', '66265673-7c5d-461d-9513-d67edf79ef4d', '021dd677-6df0-479d-aadd-2d5d0e0b565e'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.221s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:10 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:10 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Deleted volume successfully. Sep 16 22:47:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ed6fd792-b0f4-4aa4-86d9-5a60e7ab4022 tempest-VolumesTransfersV355Test-1525654051 None] Lock "cinder-ec7efabf-914d-486a-88ca-d1ff5ddd0601-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:19 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:19 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:47:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Flow 'volume_create_manager' (d5ba2826-dd03-469c-9bcc-17d4613901fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:19 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad8c2b5-e905-49bf-bf7d-a684a469ac92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad8c2b5-e905-49bf-bf7d-a684a469ac92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-275195227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6198a778-ddc7-4559-b44f-1907d3250d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f371da5a004d34ac9063e555f7682d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:20Z,use_quota=True,user_id='c1622964a0794d0da31c1b70c4677cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff4f53f-9249-4444-af83-6d443d133e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff4f53f-9249-4444-af83-6d443d133e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab2b2eb-9f3b-4746-9964-1a3b91ff234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab2b2eb-9f3b-4746-9964-1a3b91ff234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6198a778-ddc7-4559-b44f-1907d3250d7e', 'volume_name': 'volume-6198a778-ddc7-4559-b44f-1907d3250d7e', 'volume_size': 2}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da555965-5bdd-4247-93de-a99df3866a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da555965-5bdd-4247-93de-a99df3866a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9c0be5-4a46-475e-9e7e-435a6ff657f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:20 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Volume 6198a778-ddc7-4559-b44f-1907d3250d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6198a778-ddc7-4559-b44f-1907d3250d7e', 'volume_size': 2} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-275195227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6198a778-ddc7-4559-b44f-1907d3250d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f371da5a004d34ac9063e555f7682d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:20Z,use_quota=True,user_id='c1622964a0794d0da31c1b70c4677cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Creating volume 6198a778-ddc7-4559-b44f-1907d3250d7e {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:47:20 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6198a778-ddc7-4559-b44f-1907d3250d7e 2147483648 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:20 devstack quobyte-client[83246]: System call of process 93376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:20 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=73, name=volume-6198a778-ddc7-4559-b44f-1907d3250d7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6198a778-ddc7-4559-b44f-1907d3250d7e 2147483648" returned: 0 in 0.609s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6198a778-ddc7-4559-b44f-1907d3250d7e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6198a778-ddc7-4559-b44f-1907d3250d7e" returned: 0 in 0.166s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] <== create_volume: return (889ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:47:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9c0be5-4a46-475e-9e7e-435a6ff657f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6198a778-ddc7-4559-b44f-1907d3250d7e', 'volume_size': 2}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987f9ce8-9e1f-4b1e-aa35-0fe6ccd4e181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:21 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Volume volume-6198a778-ddc7-4559-b44f-1907d3250d7e (6198a778-ddc7-4559-b44f-1907d3250d7e): created successfully Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987f9ce8-9e1f-4b1e-aa35-0fe6ccd4e181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Flow 'volume_create_manager' (d5ba2826-dd03-469c-9bcc-17d4613901fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:21 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-51ab3bbb-a330-4cec-a2c2-4ad82c38da38 tempest-VolumesCloneNegativeTest-306665973 None] Created volume successfully. Sep 16 22:47:21 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (d35afdf1-21af-44ed-ac8e-d72ae226a84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ead83f9-0e95-4c2a-8269-9bdac49aed40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ead83f9-0e95-4c2a-8269-9bdac49aed40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823497139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a7b50e8-b700-4f78-8d56-3bb8780534b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:22Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c82178-07a8-492d-ba9f-a670aab73029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c82178-07a8-492d-ba9f-a670aab73029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86aaf667-dccc-45fe-88e8-214f5ee52436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86aaf667-dccc-45fe-88e8-214f5ee52436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a7b50e8-b700-4f78-8d56-3bb8780534b7', 'volume_name': 'volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0776be67-a5a2-49ff-ba74-dc977e60f7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0776be67-a5a2-49ff-ba74-dc977e60f7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d99a3fd-7ec8-4de6-82ee-6a133e127a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:21 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume 4a7b50e8-b700-4f78-8d56-3bb8780534b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7', 'volume_size': 1} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823497139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a7b50e8-b700-4f78-8d56-3bb8780534b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:22Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Creating volume 4a7b50e8-b700-4f78-8d56-3bb8780534b7 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:47:21 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:47:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:22 devstack quobyte-client[83246]: System call of process 93380 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:22 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=74, name=volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Acquiring lock "cinder-6198a778-ddc7-4559-b44f-1907d3250d7e-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 1073741824" returned: 0 in 0.461s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Lock "cinder-6198a778-ddc7-4559-b44f-1907d3250d7e-delete_volume" acquired by "delete_volume" :: waited 0.359s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7" returned: 0 in 0.334s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] <== create_volume: return (816ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d99a3fd-7ec8-4de6-82ee-6a133e127a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d804d9-3158-4992-a61e-c82f27a54e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:22 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Acquiring lock "cinder-quobyte-6198a778-ddc7-4559-b44f-1907d3250d7e" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:22 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 (4a7b50e8-b700-4f78-8d56-3bb8780534b7): created successfully Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d804d9-3158-4992-a61e-c82f27a54e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (d35afdf1-21af-44ed-ac8e-d72ae226a84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Lock "cinder-quobyte-6198a778-ddc7-4559-b44f-1907d3250d7e" acquired by "delete_volume" :: waited 0.046s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:22 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-40c21be7-9b51-4bf6-af99-e793b10419a0 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created volume successfully. Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26b7827-db34-4e7d-a23e-233276780901]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6198a778-ddc7-4559-b44f-1907d3250d7e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6198a778-ddc7-4559-b44f-1907d3250d7e" returned: 0 in 0.463s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6198a778-ddc7-4559-b44f-1907d3250d7e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-6198a778-ddc7-4559-b44f-1907d3250d7e" returned: 0 in 0.083s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Lock "cinder-quobyte-6198a778-ddc7-4559-b44f-1907d3250d7e" released by "delete_volume" :: held 0.706s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:23 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Created reservations ['71746904-cae4-41b7-92e5-ea18bfc3b3d5', '4909bfe1-4360-4d5b-9ecd-30944050f3af', 'cd712b78-c3ec-4636-97aa-3e7c718a8165', 'eed68c36-8b35-47cd-ada1-d08da487a1c4'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.325s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:24 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Deleted volume successfully. Sep 16 22:47:24 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Creating offline snapshot ec992ae0-5ef8-48c3-8c62-e4f5175558bc of volume 4a7b50e8-b700-4f78-8d56-3bb8780534b7 {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c0e33d6e-8e1e-41bb-b715-15fedd5eece1 tempest-VolumesCloneNegativeTest-306665973 None] Lock "cinder-6198a778-ddc7-4559-b44f-1907d3250d7e-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b644f7-033f-4004-a2b1-7984f27cdd9e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7" returned: 0 in 0.504s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:25 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=75, name=volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc 1G" returned: 0 in 0.253s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "qemu-img rebase -u -b volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc" returned: 0 in 0.179s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc" returned: 0 in 0.095s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc" returned: 0 in 0.110s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.info" returned: 0 in 0.113s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.info" returned: 0 in 0.101s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:26 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6ea7df31-27f4-4345-ab43-66256f973f4d tempest-CreateVolumesFromSnapshotTest-566979641 None] Create snapshot completed successfully Sep 16 22:47:27 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Flow 'volume_create_manager' (86189d45-788e-427c-99ac-30cc63c7f0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0229d60a-8518-4806-afd4-52e7342e7bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0229d60a-8518-4806-afd4-52e7342e7bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1982350029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfe8594-3755-498d-902a-5fa83e7c8829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93139db2b6314dd99cb596a311a4d814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:27Z,use_quota=True,user_id='ced4a1cafd4d4bd4808fef6561d18dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61dbc72c-0f12-4170-83d7-0f37bf040aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61dbc72c-0f12-4170-83d7-0f37bf040aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fc21ee-42c0-4c1c-912d-d174f7ed00d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fc21ee-42c0-4c1c-912d-d174f7ed00d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfe8594-3755-498d-902a-5fa83e7c8829', 'volume_name': 'volume-9dfe8594-3755-498d-902a-5fa83e7c8829', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16741f6b-cb33-4022-9463-45c5bf585264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16741f6b-cb33-4022-9463-45c5bf585264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0536f70d-1195-43c3-91d1-f448a298e2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:27 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume 9dfe8594-3755-498d-902a-5fa83e7c8829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfe8594-3755-498d-902a-5fa83e7c8829', 'volume_size': 1} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1982350029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfe8594-3755-498d-902a-5fa83e7c8829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93139db2b6314dd99cb596a311a4d814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:27Z,use_quota=True,user_id='ced4a1cafd4d4bd4808fef6561d18dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Creating volume 9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:47:27 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:47:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:27 devstack quobyte-client[83246]: System call of process 93405 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:27 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=77, name=volume-9dfe8594-3755-498d-902a-5fa83e7c8829, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:28 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (4cac07f2-acae-4267-8241-3234b219e81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f21ae43-95fd-47d8-b38a-2469df6b1f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f21ae43-95fd-47d8-b38a-2469df6b1f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067925468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab83c018-ed57-4fad-a2f6-2f8644429a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:28Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f252ee8f-ccfa-4402-a973-f5fdd5199ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f252ee8f-ccfa-4402-a973-f5fdd5199ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46b1107-d132-422a-a367-d74f13f1244f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46b1107-d132-422a-a367-d74f13f1244f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab83c018-ed57-4fad-a2f6-2f8644429a96', 'volume_name': 'volume-ab83c018-ed57-4fad-a2f6-2f8644429a96', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28772117-3c28-47e9-8f43-cf7eea307599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28772117-3c28-47e9-8f43-cf7eea307599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d050d26c-fe54-4798-8ebb-9c5ea4224424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:28 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume ab83c018-ed57-4fad-a2f6-2f8644429a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab83c018-ed57-4fad-a2f6-2f8644429a96', 'volume_size': 1} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829 1073741824" returned: 0 in 1.172s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:29 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (80376756-b1b5-49eb-bf2c-7e3eed7cd060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cfe6d7-bf05-4c69-b091-0a385c1b20b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 1.113s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829" returned: 0 in 0.556s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] <== create_volume: return (1838ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:29 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (3cb655c2-0530-4b9b-a0ee-413ca4ae77c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd9bd1c-5756-4832-80ab-b9ead4423857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067925468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab83c018-ed57-4fad-a2f6-2f8644429a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:28Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Creating volume ab83c018-ed57-4fad-a2f6-2f8644429a96 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:47:29 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:47:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ab83c018-ed57-4fad-a2f6-2f8644429a96 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:29 devstack quobyte-client[83246]: System call of process 93411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:29 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=78, name=volume-ab83c018-ed57-4fad-a2f6-2f8644429a96, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33cfe6d7-bf05-4c69-b091-0a385c1b20b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-437645362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc20830-ad80-423d-b313-e09486839425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:28Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294c7f53-2002-43ce-9f55-3727c05cb17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294c7f53-2002-43ce-9f55-3727c05cb17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00d0901-2f7f-44c0-88ab-1be608aa97af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00d0901-2f7f-44c0-88ab-1be608aa97af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc20830-ad80-423d-b313-e09486839425', 'volume_name': 'volume-edc20830-ad80-423d-b313-e09486839425', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bf34db-99b3-42bc-9ec8-4adca4c49087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bf34db-99b3-42bc-9ec8-4adca4c49087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28a72a1-f49d-4b6b-9219-e15592825277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume edc20830-ad80-423d-b313-e09486839425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc20830-ad80-423d-b313-e09486839425', 'volume_size': 1} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (3b94e47f-aabb-43bf-b641-161498b3a3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9a8209-ef12-4e48-8470-e642ccb1c2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd9bd1c-5756-4832-80ab-b9ead4423857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-300654272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ff9a17-59bc-4dc5-9ecb-ca1728118628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:29Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57133d6-b16a-4207-85c3-8f5188f277ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57133d6-b16a-4207-85c3-8f5188f277ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a44b475-55b2-4558-af04-10de94bb3157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a44b475-55b2-4558-af04-10de94bb3157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ff9a17-59bc-4dc5-9ecb-ca1728118628', 'volume_name': 'volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50422397-dd3a-404c-a017-2e4b5bd515c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50422397-dd3a-404c-a017-2e4b5bd515c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e53cc5-3316-4b2a-afb6-ef8080f9de83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume a8ff9a17-59bc-4dc5-9ecb-ca1728118628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628', 'volume_size': 1} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9a8209-ef12-4e48-8470-e642ccb1c2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1394131286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716fe222-e71e-4435-bc1d-3511930a4b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:29Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414334c4-9fae-4e84-9387-2dae6a3a247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414334c4-9fae-4e84-9387-2dae6a3a247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb9c495-a5aa-47fb-957d-c0d7939c0e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb9c495-a5aa-47fb-957d-c0d7939c0e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '716fe222-e71e-4435-bc1d-3511930a4b83', 'volume_name': 'volume-716fe222-e71e-4435-bc1d-3511930a4b83', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5855bf43-7b75-4563-abca-eba919f90bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5855bf43-7b75-4563-abca-eba919f90bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30eec580-6b92-4146-abb4-d66656669988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume 716fe222-e71e-4435-bc1d-3511930a4b83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-716fe222-e71e-4435-bc1d-3511930a4b83', 'volume_size': 1} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ab83c018-ed57-4fad-a2f6-2f8644429a96 1073741824" returned: 0 in 0.722s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ab83c018-ed57-4fad-a2f6-2f8644429a96 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0536f70d-1195-43c3-91d1-f448a298e2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfe8594-3755-498d-902a-5fa83e7c8829', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb3f470-e659-4c47-ae93-d803dbed50e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ab83c018-ed57-4fad-a2f6-2f8644429a96" returned: 0 in 0.433s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] <== create_volume: return (1172ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-437645362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc20830-ad80-423d-b313-e09486839425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:28Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Creating volume edc20830-ad80-423d-b313-e09486839425 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:47:30 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:47:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-edc20830-ad80-423d-b313-e09486839425 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:30 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume volume-9dfe8594-3755-498d-902a-5fa83e7c8829 (9dfe8594-3755-498d-902a-5fa83e7c8829): created successfully Sep 16 22:47:30 devstack quobyte-client[83246]: System call of process 93415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:30 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=79, name=volume-edc20830-ad80-423d-b313-e09486839425, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb3f470-e659-4c47-ae93-d803dbed50e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Flow 'volume_create_manager' (86189d45-788e-427c-99ac-30cc63c7f0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:31 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (3d358cd6-4642-45a7-8e77-c29e2126e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f84ee06-4d73-4246-91cd-8736d697a45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:31 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5b61b1d9-7a8d-4fba-8665-6d6198eabb26 tempest-VolumesSnapshotListTestJSON-1728383410 None] Created volume successfully. Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d050d26c-fe54-4798-8ebb-9c5ea4224424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab83c018-ed57-4fad-a2f6-2f8644429a96', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695b0957-141f-4660-956a-17ef67f0ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-edc20830-ad80-423d-b313-e09486839425 1073741824" returned: 0 in 0.627s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f84ee06-4d73-4246-91cd-8736d697a45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640611765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab302fc-762d-4cb8-afef-8d73ee7175fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:29Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5297d7-9f44-4d2f-a984-fd80ea38bbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5297d7-9f44-4d2f-a984-fd80ea38bbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f95906-7fba-4acd-b07a-b980e1905f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f95906-7fba-4acd-b07a-b980e1905f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab302fc-762d-4cb8-afef-8d73ee7175fe', 'volume_name': 'volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6621b9-931c-48ef-9c0f-0d27024f2422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6621b9-931c-48ef-9c0f-0d27024f2422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1625148-5a50-4ebc-8c1d-35beae177d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:31 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume 1ab302fc-762d-4cb8-afef-8d73ee7175fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe', 'volume_size': 1} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-edc20830-ad80-423d-b313-e09486839425 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:31 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume volume-ab83c018-ed57-4fad-a2f6-2f8644429a96 (ab83c018-ed57-4fad-a2f6-2f8644429a96): created successfully Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695b0957-141f-4660-956a-17ef67f0ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (4cac07f2-acae-4267-8241-3234b219e81e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-edc20830-ad80-423d-b313-e09486839425" returned: 0 in 0.478s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] <== create_volume: return (1179ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:47:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-300654272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ff9a17-59bc-4dc5-9ecb-ca1728118628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:29Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Creating volume a8ff9a17-59bc-4dc5-9ecb-ca1728118628 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:47:32 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28a72a1-f49d-4b6b-9219-e15592825277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc20830-ad80-423d-b313-e09486839425', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ab7ef3-1635-4af8-bfef-7b88e879abc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:32 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=80, name=volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:32 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0b3df522-6771-484c-993f-99f0438d3884 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created volume successfully. Sep 16 22:47:32 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume volume-edc20830-ad80-423d-b313-e09486839425 (edc20830-ad80-423d-b313-e09486839425): created successfully Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ab7ef3-1635-4af8-bfef-7b88e879abc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (80376756-b1b5-49eb-bf2c-7e3eed7cd060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628 1073741824" returned: 0 in 0.681s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:32 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-67693989-ff0f-4690-9f37-0bce082e8cbf tempest-CreateVolumesFromSnapshotTest-566979641 None] Created volume successfully. Sep 16 22:47:33 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628" returned: 0 in 0.348s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] <== create_volume: return (1054ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.771s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1394131286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716fe222-e71e-4435-bc1d-3511930a4b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:29Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Creating volume 716fe222-e71e-4435-bc1d-3511930a4b83 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:47:33 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-716fe222-e71e-4435-bc1d-3511930a4b83 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:33 devstack quobyte-client[83246]: System call of process 93424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:33 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=81, name=volume-716fe222-e71e-4435-bc1d-3511930a4b83, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e53cc5-3316-4b2a-afb6-ef8080f9de83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec8a5c4-55f9-4c81-8427-b386fa1f7f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:33 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628 (a8ff9a17-59bc-4dc5-9ecb-ca1728118628): created successfully Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec8a5c4-55f9-4c81-8427-b386fa1f7f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (3cb655c2-0530-4b9b-a0ee-413ca4ae77c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-716fe222-e71e-4435-bc1d-3511930a4b83 1073741824" returned: 0 in 0.523s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-716fe222-e71e-4435-bc1d-3511930a4b83 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:33 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-31d9a4bb-2248-4027-8938-30776e992e45 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created volume successfully. Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-716fe222-e71e-4435-bc1d-3511930a4b83" returned: 0 in 0.301s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] <== create_volume: return (851ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:47:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640611765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab302fc-762d-4cb8-afef-8d73ee7175fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece948eedaaa4576817aa58eb80cffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:47:29Z,use_quota=True,user_id='b47eb6da6cde4e5abadcdd1f09640fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Creating volume 1ab302fc-762d-4cb8-afef-8d73ee7175fe {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:47:34 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:34 devstack quobyte-client[83246]: System call of process 93429 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:34 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=82, name=volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30eec580-6b92-4146-abb4-d66656669988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716fe222-e71e-4435-bc1d-3511930a4b83', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233f1ea8-26b4-4fa6-b73b-ee9acf5a1499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe 1073741824" returned: 0 in 0.544s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:34 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume volume-716fe222-e71e-4435-bc1d-3511930a4b83 (716fe222-e71e-4435-bc1d-3511930a4b83): created successfully Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233f1ea8-26b4-4fa6-b73b-ee9acf5a1499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (3b94e47f-aabb-43bf-b641-161498b3a3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe" returned: 0 in 0.327s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] <== create_volume: return (920ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.911s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:35 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-2affe1a3-42bb-4eba-b26f-a1de241b6447 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created volume successfully. Sep 16 22:47:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Creating offline snapshot e1d25a75-aa3f-40fc-8cde-b5f68faf2240 of volume 9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:47:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1625148-5a50-4ebc-8c1d-35beae177d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49005da2-9c18-48ce-a192-a20a84608ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:47:35 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3facdbd-bca8-49bc-90b4-7d13e8660a23]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:35 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe (1ab302fc-762d-4cb8-afef-8d73ee7175fe): created successfully Sep 16 22:47:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49005da2-9c18-48ce-a192-a20a84608ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:47:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Flow 'volume_create_manager' (3d358cd6-4642-45a7-8e77-c29e2126e877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:47:35 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c301cbb1-e28c-4f20-a21d-582ab59c5232 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created volume successfully. Sep 16 22:47:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-1ab302fc-762d-4cb8-afef-8d73ee7175fe-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-1ab302fc-762d-4cb8-afef-8d73ee7175fe-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829" returned: 0 in 0.954s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:36 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=83, name=volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:36 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-quobyte-1ab302fc-762d-4cb8-afef-8d73ee7175fe" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 1G" returned: 0 in 0.473s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9dfe8594-3755-498d-902a-5fa83e7c8829 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-1ab302fc-762d-4cb8-afef-8d73ee7175fe" acquired by "delete_volume" :: waited 0.217s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:36 devstack quobyte-client[83246]: System call of process 93445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e467b528-3a0b-437f-b9bb-825595903290]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "qemu-img rebase -u -b volume-9dfe8594-3755-498d-902a-5fa83e7c8829 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240" returned: 0 in 0.362s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:47:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240" returned: 0 in 0.174s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240" returned: 0 in 0.143s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.info" returned: 0 in 0.171s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe" returned: 0 in 0.764s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.info" returned: 0 in 0.202s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1ab302fc-762d-4cb8-afef-8d73ee7175fe" returned: 0 in 0.372s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-1ab302fc-762d-4cb8-afef-8d73ee7175fe" released by "delete_volume" :: held 1.411s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:38 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-59d2024a-7f72-42ce-a6a7-aa09f8dc7292 tempest-VolumesSnapshotListTestJSON-1728383410 None] Create snapshot completed successfully Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Created reservations ['79014466-32d7-4fcf-91b3-10f4b302de86', '1898ceb0-e908-4b0a-bbbf-f881b21fb9c6', '6d9da4aa-2b43-40f8-a5d1-830c0f217383', '0e12db16-94d1-454c-8fe5-d4b8011196bb'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.138s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:38 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Deleted volume successfully. Sep 16 22:47:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8960c4c6-f890-49f6-8253-e4cb5713b18d tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-1ab302fc-762d-4cb8-afef-8d73ee7175fe-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:39 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-716fe222-e71e-4435-bc1d-3511930a4b83-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Creating offline snapshot 34402b8e-251d-4071-a8d9-1c72b3e1bb3c of volume 9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[1075af8b-cbd3-4711-8c7f-11f72af233b8]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-716fe222-e71e-4435-bc1d-3511930a4b83-delete_volume" acquired by "delete_volume" :: waited 0.192s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:39 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-quobyte-716fe222-e71e-4435-bc1d-3511930a4b83" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-716fe222-e71e-4435-bc1d-3511930a4b83" acquired by "delete_volume" :: waited 0.027s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa43de5f-9be2-43ec-8b6d-de29a2fa96dd]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-716fe222-e71e-4435-bc1d-3511930a4b83 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240" returned: 0 in 0.676s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:40 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfe8594-3755-498d-902a-5fa83e7c8829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:47:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:40 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=85, name=volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c 1G" returned: 0 in 0.306s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-716fe222-e71e-4435-bc1d-3511930a4b83" returned: 0 in 0.741s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-716fe222-e71e-4435-bc1d-3511930a4b83 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "qemu-img rebase -u -b volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c" returned: 0 in 0.327s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:40 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:47:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-716fe222-e71e-4435-bc1d-3511930a4b83" returned: 0 in 0.265s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c" returned: 0 in 0.191s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-716fe222-e71e-4435-bc1d-3511930a4b83" released by "delete_volume" :: held 1.281s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c" returned: 0 in 0.298s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:41 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ef1c515c-e70c-440e-82d5-3337052b555b tempest-VolumesSnapshotListTestJSON-1728383410 None] Create snapshot completed successfully Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created reservations ['9f25fcfb-e80f-4074-9a10-188d2d517124', 'd39d7168-666e-44f5-8dbe-07355d56103c', 'e5bdb64a-478d-48b7-a11c-4fcaf73d0860', 'e5935dd0-1e25-4556-ab45-a1bc5eddc94b'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.089s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:41 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:42 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Deleted volume successfully. Sep 16 22:47:42 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-509c3584-3316-4c63-927b-bed39652c756 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-716fe222-e71e-4435-bc1d-3511930a4b83-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:42 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Creating offline snapshot 4c19d6ec-b382-4490-a288-8dcef76481fc of volume 9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:47:42 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[55945ad7-864e-4c58-a912-cafd167f169d]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-a8ff9a17-59bc-4dc5-9ecb-ca1728118628-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-a8ff9a17-59bc-4dc5-9ecb-ca1728118628-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:43 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-quobyte-a8ff9a17-59bc-4dc5-9ecb-ca1728118628" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-a8ff9a17-59bc-4dc5-9ecb-ca1728118628" acquired by "delete_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:43 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33544ad-2ec0-46ec-b8cc-bb85a8f86466]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:43 devstack quobyte-client[83246]: System call of process 93484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c" returned: 0 in 0.877s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfe8594-3755-498d-902a-5fa83e7c8829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:47:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:44 devstack quobyte-client[83246]: System call of process 93491 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:44 devstack quobyte-client[83246]: System call of process 93491 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:44 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=86, name=volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:47:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628" returned: 0 in 0.660s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc 1G" returned: 0 in 0.560s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a8ff9a17-59bc-4dc5-9ecb-ca1728118628" returned: 0 in 0.167s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-a8ff9a17-59bc-4dc5-9ecb-ca1728118628" released by "delete_volume" :: held 1.032s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "qemu-img rebase -u -b volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc" returned: 0 in 0.369s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:47:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc" returned: 0 in 0.293s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc" returned: 0 in 0.309s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created reservations ['9e730a67-e09f-442e-bd03-85b1eb884b27', '577ae07f-af0d-45bc-8327-f16df2a6d2f4', '6d656c6b-f81f-4e13-91ba-ed308f15a587', 'bd465f39-354a-44dc-b42f-9a6160810a3f'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:45 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3c18bbce-c8f2-4de3-b1d7-c2d9b539739a tempest-VolumesSnapshotListTestJSON-1728383410 None] Create snapshot completed successfully Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.108s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:45 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:46 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Deleted volume successfully. Sep 16 22:47:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-878a6bbe-5c1e-438e-a757-fdaf8a2d6245 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-a8ff9a17-59bc-4dc5-9ecb-ca1728118628-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-edc20830-ad80-423d-b313-e09486839425-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-edc20830-ad80-423d-b313-e09486839425-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:47 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-quobyte-edc20830-ad80-423d-b313-e09486839425" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-edc20830-ad80-423d-b313-e09486839425" acquired by "delete_volume" :: waited 0.029s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:47 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e0239c-c50c-4d7d-ab1a-e13266f3360d]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-edc20830-ad80-423d-b313-e09486839425 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-4c19d6ec-b382-4490-a288-8dcef76481fc-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-4c19d6ec-b382-4490-a288-8dcef76481fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.140s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:49 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" acquired by "delete_snapshot" :: waited 0.049s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-quobyte-4c19d6ec-b382-4490-a288-8dcef76481fc" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-4c19d6ec-b382-4490-a288-8dcef76481fc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Deleting offline snapshot 4c19d6ec-b382-4490-a288-8dcef76481fc of volume 9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] snapshot_file for this snap is: volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-edc20830-ad80-423d-b313-e09486839425" returned: 0 in 1.624s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-edc20830-ad80-423d-b313-e09486839425 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c43876b-a012-4d25-8633-25f525c5e62a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-edc20830-ad80-423d-b313-e09486839425" returned: 0 in 0.233s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-edc20830-ad80-423d-b313-e09486839425" released by "delete_volume" :: held 2.046s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:49 devstack quobyte-client[83246]: System call of process 93545 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:49 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created reservations ['d75889ac-83fa-4ab9-a42f-c0d55f49dda5', '7d433389-95af-42dd-b00a-9da58115a473', '31c7147f-d45f-4b5e-bfc4-c832b6c99f11', '3d9698d2-24bd-4d82-b007-b0dcac011766'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc" returned: 0 in 0.734s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfe8594-3755-498d-902a-5fa83e7c8829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48582a7-393e-4775-a0d4-211d53c8197a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-ab83c018-ed57-4fad-a2f6-2f8644429a96-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:50 devstack quobyte-client[83246]: System call of process 93548 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-ab83c018-ed57-4fad-a2f6-2f8644429a96-delete_volume" acquired by "delete_volume" :: waited 0.486s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.614s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c" returned: 0 in 1.270s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:51 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:51 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfe8594-3755-498d-902a-5fa83e7c8829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:47:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:51 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Deleted volume successfully. Sep 16 22:47:51 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-quobyte-ab83c018-ed57-4fad-a2f6-2f8644429a96" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc" returned: 0 in 0.619s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bf1d8b7d-f700-45bd-b3cc-de109404f098 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-edc20830-ad80-423d-b313-e09486839425-delete_volume" released by "delete_volume" :: held 5.338s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-ab83c018-ed57-4fad-a2f6-2f8644429a96" acquired by "delete_volume" :: waited 0.291s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ec7aa3-766f-4641-a615-c02a5b3e493e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ab83c018-ed57-4fad-a2f6-2f8644429a96 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.4c19d6ec-b382-4490-a288-8dcef76481fc" returned: 0 in 0.443s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-4c19d6ec-b382-4490-a288-8dcef76481fc" released by "_delete_snapshot" :: held 3.485s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" released by "delete_snapshot" :: held 3.520s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ab83c018-ed57-4fad-a2f6-2f8644429a96" returned: 0 in 0.606s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ab83c018-ed57-4fad-a2f6-2f8644429a96 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Created reservations ['fe876676-1ebe-4e66-8c84-540c81dae658', '21254c3f-e4dc-43e3-9e89-04393e570d1d', '444fc118-0a99-45b6-9fff-e7b9395a4bd8', 'f2f091d9-4a8c-4ee7-aa36-35c226c4bfb6'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ab83c018-ed57-4fad-a2f6-2f8644429a96" returned: 0 in 0.248s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-ab83c018-ed57-4fad-a2f6-2f8644429a96" released by "delete_volume" :: held 1.120s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Delete snapshot completed successfully. Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-361eec53-7cef-49fc-9b5a-1147fcb4633c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-4c19d6ec-b382-4490-a288-8dcef76481fc-delete_snapshot" released by "delete_snapshot" :: held 4.429s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created reservations ['184dc15d-e57a-4ce6-8616-4624f0ccc720', 'c7ccfa53-06c1-44a8-bf8a-a7494e1a64d5', '1111dd8a-f7c7-4685-ad5d-ca27c9c29167', '083140b3-def8-4f7c-be68-7df6b0df05b7'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.092s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Deleted volume successfully. Sep 16 22:47:53 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-ec992ae0-5ef8-48c3-8c62-e4f5175558bc-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b64fd8a9-6c81-4f73-8253-237229cc35b3 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-ab83c018-ed57-4fad-a2f6-2f8644429a96-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-ec992ae0-5ef8-48c3-8c62-e4f5175558bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.100s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:54 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-quobyte-4a7b50e8-b700-4f78-8d56-3bb8780534b7" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-4a7b50e8-b700-4f78-8d56-3bb8780534b7" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-quobyte-ec992ae0-5ef8-48c3-8c62-e4f5175558bc" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-ec992ae0-5ef8-48c3-8c62-e4f5175558bc" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Deleting offline snapshot ec992ae0-5ef8-48c3-8c62-e4f5175558bc of volume 4a7b50e8-b700-4f78-8d56-3bb8780534b7 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] snapshot_file for this snap is: volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3c86a2-b279-463a-8236-54773f113e43]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-34402b8e-251d-4071-a8d9-1c72b3e1bb3c-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc" returned: 0 in 0.495s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-34402b8e-251d-4071-a8d9-1c72b3e1bb3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.117s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:54 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[45827fe0-a2f8-42ed-b1fa-a78a293e68d7]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" acquired by "delete_snapshot" :: waited 0.197s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-quobyte-34402b8e-251d-4071-a8d9-1c72b3e1bb3c" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-34402b8e-251d-4071-a8d9-1c72b3e1bb3c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Deleting offline snapshot 34402b8e-251d-4071-a8d9-1c72b3e1bb3c of volume 9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] snapshot_file for this snap is: volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db2d05f-d613-42fb-8a0b-c3715c0727d9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7" returned: 0 in 0.500s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc" returned: 0 in 0.216s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c" returned: 0 in 0.603s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfe8594-3755-498d-902a-5fa83e7c8829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a4edf-f469-4874-b8c9-268028f79661]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7.ec992ae0-5ef8-48c3-8c62-e4f5175558bc" returned: 0 in 0.202s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-ec992ae0-5ef8-48c3-8c62-e4f5175558bc" released by "_delete_snapshot" :: held 1.741s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-4a7b50e8-b700-4f78-8d56-3bb8780534b7" released by "delete_snapshot" :: held 1.762s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240" returned: 0 in 0.548s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfe8594-3755-498d-902a-5fa83e7c8829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:47:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:56 devstack quobyte-client[83246]: System call of process 93582 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:56 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created reservations ['360af7af-4a47-4384-b523-4d23903b743c', 'bfb1c7b3-0191-4cc8-8215-802278e1d3e1', 'd3f613d0-897a-4c68-80c3-9cf7daabffa7', '1fb645f0-62e2-4dc3-a91a-d2619d095699'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c" returned: 0 in 0.322s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.34402b8e-251d-4071-a8d9-1c72b3e1bb3c" returned: 0 in 0.192s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:56 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-34402b8e-251d-4071-a8d9-1c72b3e1bb3c" released by "_delete_snapshot" :: held 1.887s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:56 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" released by "delete_snapshot" :: held 2.033s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:57 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Delete snapshot completed successfully. Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-575bd4d8-0a97-4963-b9f5-dd4a5fa85cb9 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-ec992ae0-5ef8-48c3-8c62-e4f5175558bc-delete_snapshot" released by "delete_snapshot" :: held 3.009s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Created reservations ['d50173f4-97d8-4cfc-8ec6-b6016f1bc6b6', '9e017dd7-a499-432d-98f4-8fa6be6292f5', 'f7386213-5c2e-4416-9d01-98e9a15a608a', '055dd5a4-adb7-4369-87a2-4a1d1af78722'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-4a7b50e8-b700-4f78-8d56-3bb8780534b7-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-4a7b50e8-b700-4f78-8d56-3bb8780534b7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:57 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Delete snapshot completed successfully. Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bd7d02ad-4089-4025-81f8-eea8899a04c9 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-34402b8e-251d-4071-a8d9-1c72b3e1bb3c-delete_snapshot" released by "delete_snapshot" :: held 2.597s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "cinder-quobyte-4a7b50e8-b700-4f78-8d56-3bb8780534b7" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-4a7b50e8-b700-4f78-8d56-3bb8780534b7" acquired by "delete_volume" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[809a37b4-ce76-43d5-bd2e-4e401d0b6e60]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-e1d25a75-aa3f-40fc-8cde-b5f68faf2240-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7" returned: 0 in 0.517s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-e1d25a75-aa3f-40fc-8cde-b5f68faf2240-delete_snapshot" acquired by "delete_snapshot" :: waited 0.187s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:47:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-4a7b50e8-b700-4f78-8d56-3bb8780534b7" returned: 0 in 0.221s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-quobyte-4a7b50e8-b700-4f78-8d56-3bb8780534b7" released by "delete_volume" :: held 0.794s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" acquired by "delete_snapshot" :: waited 0.179s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-quobyte-e1d25a75-aa3f-40fc-8cde-b5f68faf2240" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-e1d25a75-aa3f-40fc-8cde-b5f68faf2240" acquired by "_delete_snapshot" :: waited 0.083s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Deleting offline snapshot e1d25a75-aa3f-40fc-8cde-b5f68faf2240 of volume 9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] snapshot_file for this snap is: volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cce8807-90ab-4694-8358-eab1d3226ec2]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Created reservations ['6024ae8d-0b02-41a9-8f8a-13bfef8523d0', 'be796855-fd59-4163-bbc9-30c100591318', '9b27eb6e-4b87-473c-af66-dc7e9d23353e', 'a832ebcc-5269-4d23-ab65-8ce6463d3a47'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240" returned: 0 in 0.525s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfe8594-3755-498d-902a-5fa83e7c8829(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7e3cc7-41db-4122-a3cb-fda0a10f2747]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:47:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.101s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:47:59 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Deleted volume successfully. Sep 16 22:47:59 devstack quobyte-client[83246]: System call of process 93593 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829" returned: 0 in 0.632s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-bef10cfb-97f1-493f-874e-8ab132264797 tempest-CreateVolumesFromSnapshotTest-566979641 None] Lock "cinder-4a7b50e8-b700-4f78-8d56-3bb8780534b7-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240" returned: 0 in 0.274s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829.e1d25a75-aa3f-40fc-8cde-b5f68faf2240" returned: 0 in 0.106s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-e1d25a75-aa3f-40fc-8cde-b5f68faf2240" released by "_delete_snapshot" :: held 1.769s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:47:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" released by "delete_snapshot" :: held 1.867s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:00 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:DELETE=13,cinder:SELECT=78,cinder:INSERT=29,cinder:UPDATE=100 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:48:00 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Created reservations ['56a53506-9e19-4993-8c68-c26315bded90', '6b2ca0d5-13da-4099-80fa-48fc28728d49', 'c7eee403-3d1d-4ff2-8a6d-0f36a3fd6896', '5dc1a4d5-3af1-4a4b-8a30-77a606b2aa41'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:48:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Delete snapshot completed successfully. Sep 16 22:48:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a914b90b-df1c-408e-a12f-7739e64005e2 tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-e1d25a75-aa3f-40fc-8cde-b5f68faf2240-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-9dfe8594-3755-498d-902a-5fa83e7c8829-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-9dfe8594-3755-498d-902a-5fa83e7c8829-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" acquired by "delete_volume" :: waited 0.013s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:01 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b34ba6-d2ba-4a47-9fb6-f78e827e628e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829" returned: 0 in 0.463s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9dfe8594-3755-498d-902a-5fa83e7c8829" returned: 0 in 0.121s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-quobyte-9dfe8594-3755-498d-902a-5fa83e7c8829" released by "delete_volume" :: held 0.764s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=126,cinder:SELECT=78,cinder:DELETE=10,cinder:INSERT=23 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Created reservations ['cf3a33ef-da41-4d7c-b5cb-b17b9f897aaf', 'db8989e2-ed5c-4eae-9d49-88216c6acd7e', '1f1fe320-3fa1-4ad9-9cfc-d96d1fa7c5f3', '5f194f5f-76c8-46a1-aabb-b8ed4cb44948'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.095s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:48:02 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Deleted volume successfully. Sep 16 22:48:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7cb0436b-7eb9-4671-a88a-4a5112e9015c tempest-VolumesSnapshotListTestJSON-1728383410 None] Lock "cinder-9dfe8594-3755-498d-902a-5fa83e7c8829-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:06 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Flow 'volume_create_manager' (167b62ae-ae4c-4343-97ed-c2ded2ec0cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea7b2a6-477e-46b1-b316-8c98053f900b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea7b2a6-477e-46b1-b316-8c98053f900b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768c4f25-2362-4e43-a3a7-0fe055e2af22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1537143644fc43458ccb87088bcedfd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:06Z,use_quota=True,user_id='024c71a4072542ed96888d69815fc36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8c40a1-cd7e-4004-a611-0e3cc0a8cfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8c40a1-cd7e-4004-a611-0e3cc0a8cfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bde5480-0d7f-42da-b8ef-26ce8ffb14b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bde5480-0d7f-42da-b8ef-26ce8ffb14b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '768c4f25-2362-4e43-a3a7-0fe055e2af22', 'volume_name': 'volume-768c4f25-2362-4e43-a3a7-0fe055e2af22', 'volume_size': 1, 'image_id': 'ae225951-6e80-4c07-9b1b-b0040fa608f5', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd95f16c46b82df1692cd8905968c2fea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1537143644fc43458ccb87088bcedfd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e694b086385bba64fde88bbbecafc5fc78e5f16facee36a0f219e46a3164d4e97ecd75c7a8b2b1b177ac7279fe120446f921a9d1cebdd46c8c3d7aa6e68f5ace', 'id': 'ae225951-6e80-4c07-9b1b-b0040fa608f5', 'created_at': datetime.datetime(2025, 9, 16, 20, 48, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae225951-6e80-4c07-9b1b-b0040fa608f5/file', 'properties': {}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ad8281-1a5b-46e9-a1ff-77255074b0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ad8281-1a5b-46e9-a1ff-77255074b0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d854737-de20-4348-a79f-27fed585971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:06 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Volume 768c4f25-2362-4e43-a3a7-0fe055e2af22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-768c4f25-2362-4e43-a3a7-0fe055e2af22', 'volume_size': 1, 'image_id': 'ae225951-6e80-4c07-9b1b-b0040fa608f5', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd95f16c46b82df1692cd8905968c2fea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1537143644fc43458ccb87088bcedfd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e694b086385bba64fde88bbbecafc5fc78e5f16facee36a0f219e46a3164d4e97ecd75c7a8b2b1b177ac7279fe120446f921a9d1cebdd46c8c3d7aa6e68f5ace', 'id': 'ae225951-6e80-4c07-9b1b-b0040fa608f5', 'created_at': datetime.datetime(2025, 9, 16, 20, 48, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae225951-6e80-4c07-9b1b-b0040fa608f5/file', 'properties': {}}, 'image_service': } Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Cloning 768c4f25-2362-4e43-a3a7-0fe055e2af22 from image ae225951-6e80-4c07-9b1b-b0040fa608f5 at location (None, None). {{(pid=83223) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 22:48:06 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Image download 0.00 MB at 0.00 MB/s Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b2e5d1-ef44-4d63-a3c2-d5466211c62c]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:07 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD Sep 16 22:48:07 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:48:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:07 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Flow 'volume_create_manager' (0e8b46de-ec46-4a64-b605-42144a742fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96b5b61-d542-4a39-8059-a89374523e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96b5b61-d542-4a39-8059-a89374523e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1823952438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda8ed6c-c82c-49a6-845a-6ebdab2770dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f72e62524a4a798f998e87e9705d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:07Z,use_quota=True,user_id='fbca6be1f10b47b4aac57d89082b3541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8efc091-d451-432b-8786-5105928db750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8efc091-d451-432b-8786-5105928db750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea70df29-416b-4817-b13a-26f1f10a2919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea70df29-416b-4817-b13a-26f1f10a2919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda8ed6c-c82c-49a6-845a-6ebdab2770dc', 'volume_name': 'volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b076e9d7-dc13-43cb-9487-7fd41f2288cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b076e9d7-dc13-43cb-9487-7fd41f2288cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff138249-a37c-4e87-ab4c-b794fe409cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:08 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Volume eda8ed6c-c82c-49a6-845a-6ebdab2770dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc', 'volume_size': 1} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1823952438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda8ed6c-c82c-49a6-845a-6ebdab2770dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f72e62524a4a798f998e87e9705d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:07Z,use_quota=True,user_id='fbca6be1f10b47b4aac57d89082b3541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Creating volume eda8ed6c-c82c-49a6-845a-6ebdab2770dc {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:08 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:08 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=87, name=volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:08 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Flow 'volume_create_manager' (be0b3bf9-d182-4ad2-a6ec-184af7250252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72ece39-823d-4d03-9662-9fb8c6822744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72ece39-823d-4d03-9662-9fb8c6822744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1653037866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17202086-d0db-4512-b64c-6bffaf572a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f72e62524a4a798f998e87e9705d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:08Z,use_quota=True,user_id='fbca6be1f10b47b4aac57d89082b3541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6347ba09-9c27-4d7c-9577-dbdeae32c133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6347ba09-9c27-4d7c-9577-dbdeae32c133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa46be06-a796-4fc6-8de4-e0a57bea8cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa46be06-a796-4fc6-8de4-e0a57bea8cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17202086-d0db-4512-b64c-6bffaf572a44', 'volume_name': 'volume-17202086-d0db-4512-b64c-6bffaf572a44', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d91adcb-7846-450b-9dd5-9c831faab564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d91adcb-7846-450b-9dd5-9c831faab564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7e961c-3b2a-42d4-ab89-282520b75d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:09 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Volume 17202086-d0db-4512-b64c-6bffaf572a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17202086-d0db-4512-b64c-6bffaf572a44', 'volume_size': 1} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc 1073741824" returned: 0 in 1.269s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:09 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Flow 'volume_create_manager' (b414d022-ee33-4055-b1c2-c5b5ef9f3e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de37bc2-ad41-4840-88b0-049592a9ad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:09 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Flow 'volume_create_manager' (fafa0378-55ff-46d0-8043-eaad022f3d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5a42bd-3d30-4733-8293-26a0ccdd6db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:10 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Sep 16 22:48:10 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Flow 'volume_create_manager' (d994518d-1540-4c8b-8ff6-3ba41aac276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85503cc-e1c4-45e3-ae7a-1deec87b4b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5a42bd-3d30-4733-8293-26a0ccdd6db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853741047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa48c170-f006-4566-b16b-c8455c97be7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f72e62524a4a798f998e87e9705d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:08Z,use_quota=True,user_id='fbca6be1f10b47b4aac57d89082b3541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59299f1c-d877-4c59-8fb7-a37163f94098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59299f1c-d877-4c59-8fb7-a37163f94098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a373714-93a8-4232-b2c6-dca167bfb4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a373714-93a8-4232-b2c6-dca167bfb4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa48c170-f006-4566-b16b-c8455c97be7e', 'volume_name': 'volume-fa48c170-f006-4566-b16b-c8455c97be7e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d6b690-239e-43dc-a163-c7f9ceb3583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d6b690-239e-43dc-a163-c7f9ceb3583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2639ce-16d3-4ebd-b555-708c4fefed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:10 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Volume fa48c170-f006-4566-b16b-c8455c97be7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa48c170-f006-4566-b16b-c8455c97be7e', 'volume_size': 1} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de37bc2-ad41-4840-88b0-049592a9ad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2069695972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b27a0c2-b1a5-4aea-8cf2-789e27db0756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f72e62524a4a798f998e87e9705d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:09Z,use_quota=True,user_id='fbca6be1f10b47b4aac57d89082b3541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e59d08-581a-4fa7-8610-985319c580f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e59d08-581a-4fa7-8610-985319c580f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51ed5ef-dbfb-4ab8-bcbb-9630d7c8cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51ed5ef-dbfb-4ab8-bcbb-9630d7c8cec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b27a0c2-b1a5-4aea-8cf2-789e27db0756', 'volume_name': 'volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ad8bc3-7de8-4945-b291-283d1b759906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ad8bc3-7de8-4945-b291-283d1b759906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ace8a66-69b0-499e-ab82-2e3561cb9cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:10 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Volume 1b27a0c2-b1a5-4aea-8cf2-789e27db0756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756', 'volume_size': 1} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD" returned: 0 in 3.530s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc" returned: 0 in 0.979s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] <== create_volume: return (2418ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.485s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.378s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1653037866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17202086-d0db-4512-b64c-6bffaf572a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f72e62524a4a798f998e87e9705d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:08Z,use_quota=True,user_id='fbca6be1f10b47b4aac57d89082b3541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Creating volume 17202086-d0db-4512-b64c-6bffaf572a44 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:10 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17202086-d0db-4512-b64c-6bffaf572a44 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:11 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=88, name=volume-17202086-d0db-4512-b64c-6bffaf572a44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:11 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD Sep 16 22:48:11 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff138249-a37c-4e87-ab4c-b794fe409cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb884bc-d7f2-47f4-b20e-9ae14ff5d8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85503cc-e1c4-45e3-ae7a-1deec87b4b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768003214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f791196c-4754-4199-a4c9-11272b744008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f72e62524a4a798f998e87e9705d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:09Z,use_quota=True,user_id='fbca6be1f10b47b4aac57d89082b3541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24749be3-4079-4f8b-8aba-8e73d92c53df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24749be3-4079-4f8b-8aba-8e73d92c53df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e25336-770e-405e-bc23-6f1ec3b0d545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e25336-770e-405e-bc23-6f1ec3b0d545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f791196c-4754-4199-a4c9-11272b744008', 'volume_name': 'volume-f791196c-4754-4199-a4c9-11272b744008', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffc2c8c-265a-4bd5-8ab2-74cd2355c193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffc2c8c-265a-4bd5-8ab2-74cd2355c193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956911ed-969f-4efa-8d49-8dba7389afcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:11 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Volume f791196c-4754-4199-a4c9-11272b744008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f791196c-4754-4199-a4c9-11272b744008', 'volume_size': 1} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:11 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Volume volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc (eda8ed6c-c82c-49a6-845a-6ebdab2770dc): created successfully Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb884bc-d7f2-47f4-b20e-9ae14ff5d8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Flow 'volume_create_manager' (0e8b46de-ec46-4a64-b605-42144a742fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17202086-d0db-4512-b64c-6bffaf572a44 1073741824" returned: 0 in 0.638s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17202086-d0db-4512-b64c-6bffaf572a44 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:11 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-62f0bafd-a7fb-41d4-b926-4c29316dc8ca tempest-CreateVolumesFromImageTest-1429783980 None] Created volume successfully. Sep 16 22:48:12 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-139ce60c-2221-4f3c-90fa-6a0c64ad3d40 req-253464b6-72c8-4d1a-9c31-16e71b4b6098 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17202086-d0db-4512-b64c-6bffaf572a44" returned: 0 in 0.699s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] <== create_volume: return (1381ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.828s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853741047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa48c170-f006-4566-b16b-c8455c97be7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f72e62524a4a798f998e87e9705d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:08Z,use_quota=True,user_id='fbca6be1f10b47b4aac57d89082b3541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Creating volume fa48c170-f006-4566-b16b-c8455c97be7e {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:12 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fa48c170-f006-4566-b16b-c8455c97be7e 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:12 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=89, name=volume-fa48c170-f006-4566-b16b-c8455c97be7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:12 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-139ce60c-2221-4f3c-90fa-6a0c64ad3d40 req-253464b6-72c8-4d1a-9c31-16e71b4b6098 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-139ce60c-2221-4f3c-90fa-6a0c64ad3d40 req-253464b6-72c8-4d1a-9c31-16e71b4b6098 tempest-AttachVolumeShelveTestJSON-1626356156 None] Terminate volume connection completed successfully. Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-139ce60c-2221-4f3c-90fa-6a0c64ad3d40 req-253464b6-72c8-4d1a-9c31-16e71b4b6098 tempest-AttachVolumeShelveTestJSON-1626356156 None] Deleting attachment 9feffea9-da7b-4a02-80eb-a32199165b5e. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7e961c-3b2a-42d4-ab89-282520b75d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17202086-d0db-4512-b64c-6bffaf572a44', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55298af-d470-409f-acf9-087dcbe4a370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fa48c170-f006-4566-b16b-c8455c97be7e 1073741824" returned: 0 in 0.596s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fa48c170-f006-4566-b16b-c8455c97be7e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:13 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Volume volume-17202086-d0db-4512-b64c-6bffaf572a44 (17202086-d0db-4512-b64c-6bffaf572a44): created successfully Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55298af-d470-409f-acf9-087dcbe4a370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Flow 'volume_create_manager' (be0b3bf9-d182-4ad2-a6ec-184af7250252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fa48c170-f006-4566-b16b-c8455c97be7e" returned: 0 in 0.590s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] <== create_volume: return (1213ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.020s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2069695972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b27a0c2-b1a5-4aea-8cf2-789e27db0756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f72e62524a4a798f998e87e9705d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:09Z,use_quota=True,user_id='fbca6be1f10b47b4aac57d89082b3541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Creating volume 1b27a0c2-b1a5-4aea-8cf2-789e27db0756 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:13 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:13 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=90, name=volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:13 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-426dfe61-7c6a-40e2-bd57-55109cd233c0 tempest-CreateVolumesFromImageTest-1429783980 None] Created volume successfully. Sep 16 22:48:13 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2639ce-16d3-4ebd-b555-708c4fefed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa48c170-f006-4566-b16b-c8455c97be7e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b9d221-79ae-420e-97b9-69a8fe465f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD" returned: 1 in 3.642s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Temporary image ae225951-6e80-4c07-9b1b-b0040fa608f5 is fetched for user 024c71a4072542ed96888d69815fc36e. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756 1073741824" returned: 0 in 0.675s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:14 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Volume volume-fa48c170-f006-4566-b16b-c8455c97be7e (fa48c170-f006-4566-b16b-c8455c97be7e): created successfully Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b9d221-79ae-420e-97b9-69a8fe465f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Flow 'volume_create_manager' (fafa0378-55ff-46d0-8043-eaad022f3d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756" returned: 0 in 0.597s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] <== create_volume: return (1308ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.414s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768003214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f791196c-4754-4199-a4c9-11272b744008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f72e62524a4a798f998e87e9705d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:09Z,use_quota=True,user_id='fbca6be1f10b47b4aac57d89082b3541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Creating volume f791196c-4754-4199-a4c9-11272b744008 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:14 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f791196c-4754-4199-a4c9-11272b744008 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:15 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-dbac1bbf-c6ee-429a-be86-e2034664fda5 tempest-CreateVolumesFromImageTest-1429783980 None] Created volume successfully. Sep 16 22:48:15 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=91, name=volume-f791196c-4754-4199-a4c9-11272b744008, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ace8a66-69b0-499e-ab82-2e3561cb9cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7190271c-dfa3-4268-87b2-7741b302fb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:15 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[1864138a-50e9-4eb2-ba8a-0eab62113a01]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f791196c-4754-4199-a4c9-11272b744008 1073741824" returned: 0 in 0.675s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f791196c-4754-4199-a4c9-11272b744008 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:16 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Volume volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756 (1b27a0c2-b1a5-4aea-8cf2-789e27db0756): created successfully Sep 16 22:48:16 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD Sep 16 22:48:16 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:48:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7190271c-dfa3-4268-87b2-7741b302fb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Flow 'volume_create_manager' (b414d022-ee33-4055-b1c2-c5b5ef9f3e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-739673fe-07f0-45f7-a3a7-39fbd03520b6 tempest-CreateVolumesFromImageTest-1429783980 None] Created volume successfully. Sep 16 22:48:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f791196c-4754-4199-a4c9-11272b744008" returned: 0 in 1.680s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] <== create_volume: return (2411ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.433s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956911ed-969f-4efa-8d49-8dba7389afcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f791196c-4754-4199-a4c9-11272b744008', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3675ae86-76a1-4735-abd7-9437f9339154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:17 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Volume volume-f791196c-4754-4199-a4c9-11272b744008 (f791196c-4754-4199-a4c9-11272b744008): created successfully Sep 16 22:48:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3675ae86-76a1-4735-abd7-9437f9339154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Flow 'volume_create_manager' (d994518d-1540-4c8b-8ff6-3ba41aac276a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b47417cb-9b6d-4587-b79c-3d59c573c160 tempest-CreateVolumesFromImageTest-1429783980 None] Created volume successfully. Sep 16 22:48:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "cinder-f791196c-4754-4199-a4c9-11272b744008-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-f791196c-4754-4199-a4c9-11272b744008-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:18 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "cinder-quobyte-f791196c-4754-4199-a4c9-11272b744008" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-quobyte-f791196c-4754-4199-a4c9-11272b744008" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:18 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a7beba-6083-434a-8a14-d89afd6b61f0]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f791196c-4754-4199-a4c9-11272b744008 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f791196c-4754-4199-a4c9-11272b744008" returned: 0 in 0.849s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f791196c-4754-4199-a4c9-11272b744008 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:19 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Sep 16 22:48:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD" returned: 0 in 4.161s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f791196c-4754-4199-a4c9-11272b744008" returned: 0 in 0.481s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-quobyte-f791196c-4754-4199-a4c9-11272b744008" released by "delete_volume" :: held 1.758s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:20 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Created reservations ['0c11025f-da39-4916-8c32-e6978431c40b', 'c99596c8-b48c-48dc-8e38-e27e1d75b1b2', 'bfe23552-7aca-447d-aeaf-5ab1b9914e1f', 'ef87d777-3ab6-4f1f-bec2-83f1a74ead89'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:48:20 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD Sep 16 22:48:20 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 22:48:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:20 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.187s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:20 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:48:21 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Deleted volume successfully. Sep 16 22:48:21 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "cinder-1b27a0c2-b1a5-4aea-8cf2-789e27db0756-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:21 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-588da0ac-77ae-46ce-b301-89ea631ac34f tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-f791196c-4754-4199-a4c9-11272b744008-delete_volume" released by "delete_volume" :: held 3.828s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:21 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-1b27a0c2-b1a5-4aea-8cf2-789e27db0756-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:22 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "cinder-quobyte-1b27a0c2-b1a5-4aea-8cf2-789e27db0756" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-quobyte-1b27a0c2-b1a5-4aea-8cf2-789e27db0756" acquired by "delete_volume" :: waited 0.013s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:22 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c83193-19e4-4ee5-8254-857fcecc203e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756" returned: 0 in 0.817s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:23 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD" returned: 1 in 3.647s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768c4f25-2362-4e43-a3a7-0fe055e2af22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1537143644fc43458ccb87088bcedfd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:06Z,use_quota=True,user_id='024c71a4072542ed96888d69815fc36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Creating volume 768c4f25-2362-4e43-a3a7-0fe055e2af22 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:23 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1b27a0c2-b1a5-4aea-8cf2-789e27db0756" returned: 0 in 0.303s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:23 devstack quobyte-client[83246]: System call of process 93721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:48:23 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=92, name=volume-768c4f25-2362-4e43-a3a7-0fe055e2af22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-quobyte-1b27a0c2-b1a5-4aea-8cf2-789e27db0756" released by "delete_volume" :: held 1.322s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 1073741824" returned: 0 in 0.409s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22" returned: 0 in 0.334s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] <== create_volume: return (805ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Created reservations ['4cca88e3-7fcd-43ce-ae35-218ceeac3363', '0bb13da0-5f40-44fd-b2b9-d09360f8390d', '176a9651-557d-472c-aa1b-c15b75d6c64f', '0b4d41e2-a932-4f39-bb88-630ef1e4b906'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Attempting download of ae225951-6e80-4c07-9b1b-b0040fa608f5 ((None, None)) to volume 768c4f25-2362-4e43-a3a7-0fe055e2af22. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf166fc-ec45-4623-93d6-4fd46ef82ac7]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae225951-6e80-4c07-9b1b-b0040fa608f5_xu87jwdk {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.109s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:24 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:48:24 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Deleted volume successfully. Sep 16 22:48:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6d7fd2b6-7ba5-4ec3-b6d1-55d1989f782b tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-1b27a0c2-b1a5-4aea-8cf2-789e27db0756-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae225951-6e80-4c07-9b1b-b0040fa608f5_xu87jwdk" returned: 0 in 0.706s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae225951-6e80-4c07-9b1b-b0040fa608f5_xu87jwdk {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "cinder-fa48c170-f006-4566-b16b-c8455c97be7e-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-fa48c170-f006-4566-b16b-c8455c97be7e-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae225951-6e80-4c07-9b1b-b0040fa608f5_xu87jwdk" returned: 1 in 0.531s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae225951-6e80-4c07-9b1b-b0040fa608f5_xu87jwdk' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:48:25 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0b4973-40a7-4672-8c82-d543a7c6922d]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:26 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:26 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "cinder-quobyte-fa48c170-f006-4566-b16b-c8455c97be7e" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:26 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-quobyte-fa48c170-f006-4566-b16b-c8455c97be7e" acquired by "delete_volume" :: waited 0.057s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:26 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dcf67d-de71-4228-a654-1b8d74d7107e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fa48c170-f006-4566-b16b-c8455c97be7e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD" returned: 0 in 0.589s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:26 devstack quobyte-client[83246]: System call of process 93731 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:48:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fa48c170-f006-4566-b16b-c8455c97be7e" returned: 0 in 0.774s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fa48c170-f006-4566-b16b-c8455c97be7e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD" returned: 1 in 0.880s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:48:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-fa48c170-f006-4566-b16b-c8455c97be7e" returned: 0 in 0.258s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:27 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] ae225951-6e80-4c07-9b1b-b0040fa608f5 was raw, converting to raw {{(pid=83223) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 22:48:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:27 devstack quobyte-client[83246]: System call of process 93741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:48:27 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=92, name=volume-768c4f25-2362-4e43-a3a7-0fe055e2af22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:27 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-quobyte-fa48c170-f006-4566-b16b-c8455c97be7e" released by "delete_volume" :: held 1.563s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22" returned: 0 in 0.737s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:28 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae225951-6e80-4c07-9b1b-b0040fa608f5_92pd0m2wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 22:48:28 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 22:48:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:28 devstack quobyte-client[83246]: System call of process 93744 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:48:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:48:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 1G" returned: 0 in 0.930s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.663s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:29 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:48:29 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b71100-af7c-44a3-ac9b-6a0f56c6ff13]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:29 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Created reservations ['58a254b3-6c6d-4a58-90d6-e63ebe8d9cd2', 'b773c63e-26b7-498b-9268-c285ce5cef14', 'a90c171c-3dff-45c8-bc93-cbb8011ec5a9', '6b3aed43-0ad9-414f-bff1-beb003af49c2'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:48:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "cinder-17202086-d0db-4512-b64c-6bffaf572a44-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22" returned: 0 in 0.827s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-17202086-d0db-4512-b64c-6bffaf572a44-delete_volume" acquired by "delete_volume" :: waited 0.420s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:31 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "cinder-quobyte-17202086-d0db-4512-b64c-6bffaf572a44" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22" returned: 1 in 1.158s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Downloaded image ae225951-6e80-4c07-9b1b-b0040fa608f5 ((None, None)) to volume 768c4f25-2362-4e43-a3a7-0fe055e2af22 successfully. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Temporary image ae225951-6e80-4c07-9b1b-b0040fa608f5 for user 024c71a4072542ed96888d69815fc36e is deleted. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Marking volume 768c4f25-2362-4e43-a3a7-0fe055e2af22 as bootable. {{(pid=83223) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.520s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-quobyte-17202086-d0db-4512-b64c-6bffaf572a44" acquired by "delete_volume" :: waited 0.192s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:31 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Deleted volume successfully. Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Copying metadata from image ae225951-6e80-4c07-9b1b-b0040fa608f5 to 768c4f25-2362-4e43-a3a7-0fe055e2af22. {{(pid=83223) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Creating volume glance metadata for volume 768c4f25-2362-4e43-a3a7-0fe055e2af22 backed by image ae225951-6e80-4c07-9b1b-b0040fa608f5 with: {'image_id': 'ae225951-6e80-4c07-9b1b-b0040fa608f5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd95f16c46b82df1692cd8905968c2fea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83223) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[59da7638-5ba4-43fa-8ba7-588ff7c746ea]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17202086-d0db-4512-b64c-6bffaf572a44 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:32 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3ab5c3b1-5a1d-4b0b-bdb2-00b7c067e18d tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-fa48c170-f006-4566-b16b-c8455c97be7e-delete_volume" released by "delete_volume" :: held 6.623s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d854737-de20-4348-a79f-27fed585971e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768c4f25-2362-4e43-a3a7-0fe055e2af22', 'volume_size': 1, 'image_id': 'ae225951-6e80-4c07-9b1b-b0040fa608f5', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd95f16c46b82df1692cd8905968c2fea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1537143644fc43458ccb87088bcedfd1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e694b086385bba64fde88bbbecafc5fc78e5f16facee36a0f219e46a3164d4e97ecd75c7a8b2b1b177ac7279fe120446f921a9d1cebdd46c8c3d7aa6e68f5ace', 'id': 'ae225951-6e80-4c07-9b1b-b0040fa608f5', 'created_at': datetime.datetime(2025, 9, 16, 20, 48, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae225951-6e80-4c07-9b1b-b0040fa608f5/file', 'properties': {}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e490a766-fd19-4bfb-a7c5-29326ab8bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:32 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Volume volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 (768c4f25-2362-4e43-a3a7-0fe055e2af22): created successfully Sep 16 22:48:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e490a766-fd19-4bfb-a7c5-29326ab8bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Flow 'volume_create_manager' (167b62ae-ae4c-4343-97ed-c2ded2ec0cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17202086-d0db-4512-b64c-6bffaf572a44" returned: 0 in 0.790s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17202086-d0db-4512-b64c-6bffaf572a44 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:32 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-2132acdc-1e7a-49a5-b0e7-a8be94ec804b tempest-VolumeImageDependencyTests-566915945 None] Created volume successfully. Sep 16 22:48:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17202086-d0db-4512-b64c-6bffaf572a44" returned: 0 in 0.317s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:32 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-quobyte-17202086-d0db-4512-b64c-6bffaf572a44" released by "delete_volume" :: held 1.381s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:32 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Created reservations ['8ddb2a21-e0d7-4397-a80e-16789ab81d7f', '04420afd-d620-40aa-bd3c-2e074b7e785d', 'e29f0d46-9fb7-42d1-bfb1-d8ef3215b3cd', '6e1c5e0e-f354-4a8c-9ecc-2491f7f29b6a'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Acquiring lock "cinder-768c4f25-2362-4e43-a3a7-0fe055e2af22-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "cinder-eda8ed6c-c82c-49a6-845a-6ebdab2770dc-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Lock "cinder-768c4f25-2362-4e43-a3a7-0fe055e2af22-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-eda8ed6c-c82c-49a6-845a-6ebdab2770dc-delete_volume" acquired by "delete_volume" :: waited 0.229s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.613s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:48:33 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Deleted volume successfully. Sep 16 22:48:33 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Acquiring lock "cinder-quobyte-768c4f25-2362-4e43-a3a7-0fe055e2af22" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a70374b8-7ace-408c-822c-2682adac3409 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-17202086-d0db-4512-b64c-6bffaf572a44-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Lock "cinder-quobyte-768c4f25-2362-4e43-a3a7-0fe055e2af22" acquired by "delete_volume" :: waited 0.049s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:34 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:34 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "cinder-quobyte-eda8ed6c-c82c-49a6-845a-6ebdab2770dc" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:34 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89b9ed8-9739-40e1-9f58-394a3b37cb00]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:34 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-quobyte-eda8ed6c-c82c-49a6-845a-6ebdab2770dc" acquired by "delete_volume" :: waited 0.163s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:34 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ea1b3-e259-4cf3-b75f-03ca116e508a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22" returned: 0 in 0.597s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc" returned: 0 in 0.603s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-eda8ed6c-c82c-49a6-845a-6ebdab2770dc" returned: 0 in 0.122s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-quobyte-eda8ed6c-c82c-49a6-845a-6ebdab2770dc" released by "delete_volume" :: held 1.060s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22" returned: 1 in 0.737s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 22:48:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-768c4f25-2362-4e43-a3a7-0fe055e2af22" returned: 0 in 0.321s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Lock "cinder-quobyte-768c4f25-2362-4e43-a3a7-0fe055e2af22" released by "delete_volume" :: held 1.935s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Created reservations ['211e7807-dc61-43b0-aa84-d4f7ab458690', '9b15ea0b-70df-444a-810f-7bda3d28a307', 'a5228719-72fc-4923-bc59-778c5aa7cc9a', '21a44085-c4c6-4a78-9339-e57b761ac3a5'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Created reservations ['13d1c955-9fd9-48f2-9b95-7fbfac5f9202', 'b493dc9d-df54-4bb1-8cc4-2d8e498c8cc9', 'e4d1f59e-f6e6-4d67-beea-3f5c989d88f7', '981f11ab-0103-42b9-8590-f49f45f9a792'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.203s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:48:36 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Deleted volume successfully. Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f2280672-0105-4d92-8635-b72d93d9953f tempest-VolumeImageDependencyTests-566915945 None] Lock "cinder-768c4f25-2362-4e43-a3a7-0fe055e2af22-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.238s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:36 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:48:37 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Deleted volume successfully. Sep 16 22:48:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-857636b8-ecc5-4b26-80f5-6e9e7a9eab09 tempest-CreateVolumesFromImageTest-1429783980 None] Lock "cinder-eda8ed6c-c82c-49a6-845a-6ebdab2770dc-delete_volume" released by "delete_volume" :: held 3.690s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:40 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:40 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (faeed4e1-fb11-40a1-83a1-7c57511343fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1ecf01-4aa9-4312-9011-809129c7f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:41 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Flow 'volume_create_manager' (dc81e8af-8198-4b01-b13b-27ab0a566687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc78c20-54a4-47b6-9305-5b3f4b77127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc78c20-54a4-47b6-9305-5b3f4b77127a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a68877-a216-47ed-8b4a-e518d94be893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e210d2f298b499ea418a71691bebda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:41Z,use_quota=True,user_id='5b5b6a11f45f496e8ac8516c01fb5c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e8e968-4602-4310-afbc-20cbd762632b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e8e968-4602-4310-afbc-20cbd762632b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43caa57f-b2f5-41e2-a4f9-a67fd6ad8b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43caa57f-b2f5-41e2-a4f9-a67fd6ad8b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a68877-a216-47ed-8b4a-e518d94be893', 'volume_name': 'volume-94a68877-a216-47ed-8b4a-e518d94be893', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957dc9db-d514-49e0-9c53-83bf43dacf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957dc9db-d514-49e0-9c53-83bf43dacf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1728427-ea2f-47df-b2e3-de58f4d7bc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:41 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Volume 94a68877-a216-47ed-8b4a-e518d94be893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a68877-a216-47ed-8b4a-e518d94be893', 'volume_size': 1} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a68877-a216-47ed-8b4a-e518d94be893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e210d2f298b499ea418a71691bebda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:41Z,use_quota=True,user_id='5b5b6a11f45f496e8ac8516c01fb5c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Creating volume 94a68877-a216-47ed-8b4a-e518d94be893 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:41 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-94a68877-a216-47ed-8b4a-e518d94be893 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:41 devstack quobyte-client[83246]: System call of process 93774 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:48:41 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=93, name=volume-94a68877-a216-47ed-8b4a-e518d94be893, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1ecf01-4aa9-4312-9011-809129c7f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1884408430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7300b4e-f216-4a28-a041-acaaafc547bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:41Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bea43b-ec81-40d9-bbc5-1250fbb557ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bea43b-ec81-40d9-bbc5-1250fbb557ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e4de4c-96ec-45be-8c46-130d04540f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e4de4c-96ec-45be-8c46-130d04540f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7300b4e-f216-4a28-a041-acaaafc547bd', 'volume_name': 'volume-d7300b4e-f216-4a28-a041-acaaafc547bd', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71b6bb9-eefd-4db1-8633-93b5c181a87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71b6bb9-eefd-4db1-8633-93b5c181a87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ae6585-a233-433f-975e-93b18229298d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:41 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume d7300b4e-f216-4a28-a041-acaaafc547bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7300b4e-f216-4a28-a041-acaaafc547bd', 'volume_size': 1} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-94a68877-a216-47ed-8b4a-e518d94be893 1073741824" returned: 0 in 0.462s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-94a68877-a216-47ed-8b4a-e518d94be893 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-94a68877-a216-47ed-8b4a-e518d94be893" returned: 0 in 0.253s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] <== create_volume: return (768ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.507s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1884408430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7300b4e-f216-4a28-a041-acaaafc547bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:41Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Creating volume d7300b4e-f216-4a28-a041-acaaafc547bd {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:42 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d7300b4e-f216-4a28-a041-acaaafc547bd 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:42 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=94, name=volume-d7300b4e-f216-4a28-a041-acaaafc547bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1728427-ea2f-47df-b2e3-de58f4d7bc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a68877-a216-47ed-8b4a-e518d94be893', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae21230f-bd11-4ac1-bb1e-dc6a9486fb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d7300b4e-f216-4a28-a041-acaaafc547bd 1073741824" returned: 0 in 0.497s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d7300b4e-f216-4a28-a041-acaaafc547bd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:43 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Volume volume-94a68877-a216-47ed-8b4a-e518d94be893 (94a68877-a216-47ed-8b4a-e518d94be893): created successfully Sep 16 22:48:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae21230f-bd11-4ac1-bb1e-dc6a9486fb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Flow 'volume_create_manager' (dc81e8af-8198-4b01-b13b-27ab0a566687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d7300b4e-f216-4a28-a041-acaaafc547bd" returned: 0 in 1.017s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] <== create_volume: return (1560ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3faa128e-22c0-4c8f-8e99-333ce28c9f43 tempest-CinderUnicodeTest-1812019705 None] Created volume successfully. Sep 16 22:48:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ae6585-a233-433f-975e-93b18229298d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7300b4e-f216-4a28-a041-acaaafc547bd', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd49fb75-e4d9-4816-a9c3-26c99e004f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:43 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume volume-d7300b4e-f216-4a28-a041-acaaafc547bd (d7300b4e-f216-4a28-a041-acaaafc547bd): created successfully Sep 16 22:48:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd49fb75-e4d9-4816-a9c3-26c99e004f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (faeed4e1-fb11-40a1-83a1-7c57511343fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a1ca8786-61c0-4e9d-a764-32f2330d7cc8 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created volume successfully. Sep 16 22:48:44 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Flow 'volume_create_manager' (0eb44d36-0a76-469f-9b05-dbaae94d2579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac446766-1a92-4c86-8ab5-26e8dc687448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac446766-1a92-4c86-8ab5-26e8dc687448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-497915964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14d51b3-ca2e-4682-a867-932a60dcd05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e210d2f298b499ea418a71691bebda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:44Z,use_quota=True,user_id='5b5b6a11f45f496e8ac8516c01fb5c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf16b54-5464-477d-a825-4129f2ee95cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf16b54-5464-477d-a825-4129f2ee95cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838e9f3a-a097-4612-9664-33deec260993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838e9f3a-a097-4612-9664-33deec260993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e14d51b3-ca2e-4682-a867-932a60dcd05d', 'volume_name': 'volume-e14d51b3-ca2e-4682-a867-932a60dcd05d', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b178e104-0466-4dfb-be66-0fdec08f4c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b178e104-0466-4dfb-be66-0fdec08f4c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43d2675-084b-4e4b-81b8-74efd42d6a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:44 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Volume e14d51b3-ca2e-4682-a867-932a60dcd05d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e14d51b3-ca2e-4682-a867-932a60dcd05d', 'volume_size': 1} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-497915964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14d51b3-ca2e-4682-a867-932a60dcd05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e210d2f298b499ea418a71691bebda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:44Z,use_quota=True,user_id='5b5b6a11f45f496e8ac8516c01fb5c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Creating volume e14d51b3-ca2e-4682-a867-932a60dcd05d {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:44 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:44 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=95, name=volume-e14d51b3-ca2e-4682-a867-932a60dcd05d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d 1073741824" returned: 0 in 0.550s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d" returned: 0 in 0.805s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] <== create_volume: return (1528ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43d2675-084b-4e4b-81b8-74efd42d6a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14d51b3-ca2e-4682-a867-932a60dcd05d', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc8e572-1103-4b4a-945b-37243b0fc6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:46 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (07561603-1d58-4d2f-9240-1ebeeba46d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0acc4d-4b4f-4ccf-bec8-4b23944f7599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:46 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (6069598b-3270-419a-b055-854e0b87f4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b478a8a0-4944-4041-9bfa-0540eabc2b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b478a8a0-4944-4041-9bfa-0540eabc2b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029979625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdf6196-48c7-4550-bde3-2d06ca616df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:45Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db37813-8598-4044-826f-6f47fca024b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db37813-8598-4044-826f-6f47fca024b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b819087-9ec7-4064-b028-4f1fc08ecced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b819087-9ec7-4064-b028-4f1fc08ecced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdf6196-48c7-4550-bde3-2d06ca616df5', 'volume_name': 'volume-9fdf6196-48c7-4550-bde3-2d06ca616df5', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625e6a54-685d-4079-8239-fdf709dabd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625e6a54-685d-4079-8239-fdf709dabd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684d297d-8d28-4f89-aec3-c169df486e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:46 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume 9fdf6196-48c7-4550-bde3-2d06ca616df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdf6196-48c7-4550-bde3-2d06ca616df5', 'volume_size': 1} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029979625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdf6196-48c7-4550-bde3-2d06ca616df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:45Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Creating volume 9fdf6196-48c7-4550-bde3-2d06ca616df5 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:46 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9fdf6196-48c7-4550-bde3-2d06ca616df5 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:46 devstack quobyte-client[83246]: System call of process 93804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:48:46 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Volume volume-e14d51b3-ca2e-4682-a867-932a60dcd05d (e14d51b3-ca2e-4682-a867-932a60dcd05d): created successfully Sep 16 22:48:46 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=96, name=volume-9fdf6196-48c7-4550-bde3-2d06ca616df5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc8e572-1103-4b4a-945b-37243b0fc6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Flow 'volume_create_manager' (0eb44d36-0a76-469f-9b05-dbaae94d2579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0acc4d-4b4f-4ccf-bec8-4b23944f7599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13051304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2224fae2-416e-4104-8924-4f43dd2ae561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:46Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b292b8f1-fda8-4606-b62d-56b4d11fb937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b292b8f1-fda8-4606-b62d-56b4d11fb937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33f0ea7-1ede-46fd-b3e5-9ae6f3e3a89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33f0ea7-1ede-46fd-b3e5-9ae6f3e3a89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2224fae2-416e-4104-8924-4f43dd2ae561', 'volume_name': 'volume-2224fae2-416e-4104-8924-4f43dd2ae561', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0d37ef-62b8-4da7-a82b-290c4be95a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0d37ef-62b8-4da7-a82b-290c4be95a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8ea482-8b1f-432e-99bf-5c60e14eebb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:47 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume 2224fae2-416e-4104-8924-4f43dd2ae561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2224fae2-416e-4104-8924-4f43dd2ae561', 'volume_size': 1} Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:47 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6529e570-d7fc-4a99-b7de-98ba298f9f57 tempest-CinderUnicodeTest-1812019705 None] Created volume successfully. Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9fdf6196-48c7-4550-bde3-2d06ca616df5 1073741824" returned: 0 in 0.836s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9fdf6196-48c7-4550-bde3-2d06ca616df5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:48 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (0c385f31-b175-441f-8f21-8d796aff38b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3bf2d7-894d-432b-9297-873581989d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3bf2d7-894d-432b-9297-873581989d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-362068513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd8f11c-adef-4a18-98eb-53a1bd5e44f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:47Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd717efb-ae7c-4bad-a5b8-99dde13ec2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd717efb-ae7c-4bad-a5b8-99dde13ec2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998fc3dd-ad0b-4b2a-a38f-5f2dcb9ae804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998fc3dd-ad0b-4b2a-a38f-5f2dcb9ae804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd8f11c-adef-4a18-98eb-53a1bd5e44f5', 'volume_name': 'volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae99bcfa-62a2-4d11-a085-3793492bf46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae99bcfa-62a2-4d11-a085-3793492bf46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0e36e0-52aa-47fc-84e3-33f0ef09658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:48 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume acd8f11c-adef-4a18-98eb-53a1bd5e44f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5', 'volume_size': 1} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9fdf6196-48c7-4550-bde3-2d06ca616df5" returned: 0 in 1.427s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] <== create_volume: return (2328ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13051304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2224fae2-416e-4104-8924-4f43dd2ae561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:46Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Creating volume 2224fae2-416e-4104-8924-4f43dd2ae561 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:48 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2224fae2-416e-4104-8924-4f43dd2ae561 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:48 devstack quobyte-client[83246]: System call of process 93813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:48:48 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=97, name=volume-2224fae2-416e-4104-8924-4f43dd2ae561, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:49 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:49 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (8364418d-41a1-43d2-99c2-09829d2f827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2751c7-9fea-43d7-91f0-a04a17eef4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (a94d8d78-9211-4f3b-954a-275454c30a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cbc1e6-3dd8-44aa-85f3-2a108fd091f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684d297d-8d28-4f89-aec3-c169df486e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdf6196-48c7-4550-bde3-2d06ca616df5', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab61768-5728-4fca-8b2a-ab2c8f64104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2751c7-9fea-43d7-91f0-a04a17eef4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-847559221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0879669-78ea-47a0-bd71-cea13753b0ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:48Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69dc6a8-143f-4d2b-bb74-d907c1ff4e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69dc6a8-143f-4d2b-bb74-d907c1ff4e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0459e0c2-401d-47e4-969a-a7b82d365128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0459e0c2-401d-47e4-969a-a7b82d365128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0879669-78ea-47a0-bd71-cea13753b0ba', 'volume_name': 'volume-b0879669-78ea-47a0-bd71-cea13753b0ba', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6791575d-0b25-4321-a2a9-581319977cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6791575d-0b25-4321-a2a9-581319977cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476fa8aa-2e79-4acf-a975-71fda44b0b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume b0879669-78ea-47a0-bd71-cea13753b0ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0879669-78ea-47a0-bd71-cea13753b0ba', 'volume_size': 1} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:49 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume volume-9fdf6196-48c7-4550-bde3-2d06ca616df5 (9fdf6196-48c7-4550-bde3-2d06ca616df5): created successfully Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab61768-5728-4fca-8b2a-ab2c8f64104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (6069598b-3270-419a-b055-854e0b87f4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cbc1e6-3dd8-44aa-85f3-2a108fd091f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289921704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f16eb8-109d-490c-909d-4ec30cc38daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:48Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594e1c7e-1667-4f8f-a4a7-353490240d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594e1c7e-1667-4f8f-a4a7-353490240d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3e1829-e0ce-4c5c-b729-9ac0fd101b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3e1829-e0ce-4c5c-b729-9ac0fd101b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f16eb8-109d-490c-909d-4ec30cc38daf', 'volume_name': 'volume-56f16eb8-109d-490c-909d-4ec30cc38daf', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cec9612-76f2-4c10-b4ec-e501ba95b5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cec9612-76f2-4c10-b4ec-e501ba95b5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186f93c7-f0ec-4758-85ef-2f69b0a371e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:49 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume 56f16eb8-109d-490c-909d-4ec30cc38daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f16eb8-109d-490c-909d-4ec30cc38daf', 'volume_size': 1} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2224fae2-416e-4104-8924-4f43dd2ae561 1073741824" returned: 0 in 1.142s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2224fae2-416e-4104-8924-4f43dd2ae561 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:50 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-616a4371-0ea4-43df-b786-fb0e6d614ddd tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created volume successfully. Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2224fae2-416e-4104-8924-4f43dd2ae561" returned: 0 in 0.435s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] <== create_volume: return (1601ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-362068513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd8f11c-adef-4a18-98eb-53a1bd5e44f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:47Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Creating volume acd8f11c-adef-4a18-98eb-53a1bd5e44f5 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:50 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:50 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=98, name=volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8ea482-8b1f-432e-99bf-5c60e14eebb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2224fae2-416e-4104-8924-4f43dd2ae561', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ead64e-b4cb-447b-bc62-ffcb45baaa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:50 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume volume-2224fae2-416e-4104-8924-4f43dd2ae561 (2224fae2-416e-4104-8924-4f43dd2ae561): created successfully Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ead64e-b4cb-447b-bc62-ffcb45baaa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (07561603-1d58-4d2f-9240-1ebeeba46d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5 1073741824" returned: 0 in 0.486s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:50 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5b568ef6-8d5f-48a4-b19d-e978e89cae39 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created volume successfully. Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5" returned: 0 in 0.265s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] <== create_volume: return (780ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.067s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Creating offline snapshot 03cde6b1-612d-4383-ad77-8d3fe8fa3b7b of volume e14d51b3-ca2e-4682-a867-932a60dcd05d {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd6fdc-1b06-4d39-84f1-1bd513deb8ad]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0e36e0-52aa-47fc-84e3-33f0ef09658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684cac35-04d4-4938-9c2a-2268b574b5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:51 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5 (acd8f11c-adef-4a18-98eb-53a1bd5e44f5): created successfully Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684cac35-04d4-4938-9c2a-2268b574b5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (0c385f31-b175-441f-8f21-8d796aff38b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:51 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-51474281-6944-4584-9de4-dffd7336b32d tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created volume successfully. Sep 16 22:48:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d" returned: 0 in 0.640s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:52 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=99, name=volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b 1G" returned: 0 in 0.204s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e14d51b3-ca2e-4682-a867-932a60dcd05d -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] CMD "qemu-img rebase -u -b volume-e14d51b3-ca2e-4682-a867-932a60dcd05d -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b" returned: 0 in 0.123s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b" returned: 0 in 0.197s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.info" returned: 0 in 0.112s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:48:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.info" returned: 0 in 0.097s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.502s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-847559221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0879669-78ea-47a0-bd71-cea13753b0ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:48Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Creating volume b0879669-78ea-47a0-bd71-cea13753b0ba {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:53 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0879669-78ea-47a0-bd71-cea13753b0ba 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:53 devstack quobyte-client[83246]: System call of process 93871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:48:53 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=101, name=volume-b0879669-78ea-47a0-bd71-cea13753b0ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3133e563-d9b6-48c4-9283-e45273c99837 tempest-CinderUnicodeTest-1812019705 None] Create snapshot completed successfully Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0879669-78ea-47a0-bd71-cea13753b0ba 1073741824" returned: 0 in 0.388s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0879669-78ea-47a0-bd71-cea13753b0ba {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0879669-78ea-47a0-bd71-cea13753b0ba" returned: 0 in 0.161s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] <== create_volume: return (595ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.161s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289921704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f16eb8-109d-490c-909d-4ec30cc38daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b468bef95314340ad05b53829c14c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:48:48Z,use_quota=True,user_id='3a05c04c351c46b9ab44376cb0cf2b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Creating volume 56f16eb8-109d-490c-909d-4ec30cc38daf {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:48:54 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-56f16eb8-109d-490c-909d-4ec30cc38daf 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:54 devstack quobyte-client[83246]: System call of process 93878 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:48:54 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=102, name=volume-56f16eb8-109d-490c-909d-4ec30cc38daf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476fa8aa-2e79-4acf-a975-71fda44b0b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0879669-78ea-47a0-bd71-cea13753b0ba', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d713f910-c804-4d02-a276-d6c3f7d0ab97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:54 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume volume-b0879669-78ea-47a0-bd71-cea13753b0ba (b0879669-78ea-47a0-bd71-cea13753b0ba): created successfully Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d713f910-c804-4d02-a276-d6c3f7d0ab97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (8364418d-41a1-43d2-99c2-09829d2f827c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-56f16eb8-109d-490c-909d-4ec30cc38daf 1073741824" returned: 0 in 0.535s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-56f16eb8-109d-490c-909d-4ec30cc38daf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:54 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-91fd81a1-895c-4796-beb7-f0a20720db00 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created volume successfully. Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "cinder-03cde6b1-612d-4383-ad77-8d3fe8fa3b7b-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-56f16eb8-109d-490c-909d-4ec30cc38daf" returned: 0 in 0.547s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] <== create_volume: return (1131ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-03cde6b1-612d-4383-ad77-8d3fe8fa3b7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.141s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:55 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "cinder-quobyte-e14d51b3-ca2e-4682-a867-932a60dcd05d" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-quobyte-e14d51b3-ca2e-4682-a867-932a60dcd05d" acquired by "delete_snapshot" :: waited 0.135s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "cinder-quobyte-03cde6b1-612d-4383-ad77-8d3fe8fa3b7b" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186f93c7-f0ec-4758-85ef-2f69b0a371e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f16eb8-109d-490c-909d-4ec30cc38daf', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc47c1d-2ad9-407e-9b48-17cd2a13edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-quobyte-03cde6b1-612d-4383-ad77-8d3fe8fa3b7b" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Deleting offline snapshot 03cde6b1-612d-4383-ad77-8d3fe8fa3b7b of volume e14d51b3-ca2e-4682-a867-932a60dcd05d {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] snapshot_file for this snap is: volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:48:55 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume volume-56f16eb8-109d-490c-909d-4ec30cc38daf (56f16eb8-109d-490c-909d-4ec30cc38daf): created successfully Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc47c1d-2ad9-407e-9b48-17cd2a13edb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Flow 'volume_create_manager' (a94d8d78-9211-4f3b-954a-275454c30a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[84867a5a-b616-44b9-97df-36df04e4ce42]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:55 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3f491b64-9033-4dd7-bd65-d868badacd5c tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created volume successfully. Sep 16 22:48:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b" returned: 0 in 0.625s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e14d51b3-ca2e-4682-a867-932a60dcd05d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:48:56 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08681f2-7837-4bf7-921a-50cf74ce1f44]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-56f16eb8-109d-490c-909d-4ec30cc38daf-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d" returned: 0 in 1.402s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-56f16eb8-109d-490c-909d-4ec30cc38daf-delete_volume" acquired by "delete_volume" :: waited 0.209s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b" returned: 0 in 0.915s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:59 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:48:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-quobyte-56f16eb8-109d-490c-909d-4ec30cc38daf" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:48:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d.03cde6b1-612d-4383-ad77-8d3fe8fa3b7b" returned: 0 in 0.464s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:48:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-56f16eb8-109d-490c-909d-4ec30cc38daf" acquired by "delete_volume" :: waited 0.167s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:48:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-quobyte-03cde6b1-612d-4383-ad77-8d3fe8fa3b7b" released by "_delete_snapshot" :: held 4.258s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:48:59 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdd1f81-752a-480f-85f0-47fabfa74215]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:48:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-56f16eb8-109d-490c-909d-4ec30cc38daf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:48:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-quobyte-e14d51b3-ca2e-4682-a867-932a60dcd05d" released by "delete_snapshot" :: held 4.512s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:00 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=117,cinder:SELECT=57,cinder:INSERT=17,cinder:DELETE=6 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:49:00 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Created reservations ['a6f03758-f901-4de2-8452-64653bcb9df8', 'f85aa5dd-5cbd-430f-b6d5-e392e1f62508', 'f19aeda6-7dea-4c30-b2c6-5f54f99b9664', '75f04595-f0ad-4c68-8712-45e215fc3a14'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Delete snapshot completed successfully. Sep 16 22:49:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-af728ca4-710c-44f2-b14f-94185f80b400 tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-03cde6b1-612d-4383-ad77-8d3fe8fa3b7b-delete_snapshot" released by "delete_snapshot" :: held 5.491s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:00 devstack quobyte-client[83246]: System call of process 93953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:49:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-56f16eb8-109d-490c-909d-4ec30cc38daf" returned: 0 in 1.211s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-56f16eb8-109d-490c-909d-4ec30cc38daf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-56f16eb8-109d-490c-909d-4ec30cc38daf" returned: 0 in 0.186s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-56f16eb8-109d-490c-909d-4ec30cc38daf" released by "delete_volume" :: held 1.625s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "cinder-e14d51b3-ca2e-4682-a867-932a60dcd05d-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-e14d51b3-ca2e-4682-a867-932a60dcd05d-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:01 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created reservations ['7ca4e3bf-5477-48e2-be74-0f6b013a81d3', '7bce387f-5acc-492f-a29a-66388240e126', 'd47992d6-f26b-4cca-a27a-3b0dc0b6d9bc', '91b81d1d-9469-472a-ae10-fe146d7a070a'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "cinder-quobyte-e14d51b3-ca2e-4682-a867-932a60dcd05d" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-quobyte-e14d51b3-ca2e-4682-a867-932a60dcd05d" acquired by "delete_volume" :: waited 0.023s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:02 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7ed607-2457-4d99-80bc-413cd85b3527]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:02 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=69,cinder:UPDATE=71,cinder:DELETE=16,cinder:INSERT=24 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:49:02 devstack quobyte-client[83246]: System call of process 93967 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:49:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d" returned: 0 in 0.785s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-b0879669-78ea-47a0-bd71-cea13753b0ba-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e14d51b3-ca2e-4682-a867-932a60dcd05d" returned: 0 in 0.571s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-b0879669-78ea-47a0-bd71-cea13753b0ba-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.480s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-quobyte-e14d51b3-ca2e-4682-a867-932a60dcd05d" released by "delete_volume" :: held 1.594s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:49:03 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Deleted volume successfully. Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e56b9479-c021-4fc7-8f6b-1a9f6b726e53 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-56f16eb8-109d-490c-909d-4ec30cc38daf-delete_volume" released by "delete_volume" :: held 6.232s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:03 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-quobyte-b0879669-78ea-47a0-bd71-cea13753b0ba" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-b0879669-78ea-47a0-bd71-cea13753b0ba" acquired by "delete_volume" :: waited 0.065s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Created reservations ['59593638-1d9a-44de-abce-ee8a893f66ea', '609e7ad6-729d-4874-b599-2d223c380310', '96349edf-f996-4d1c-b04d-a00bbf523f8c', '07ce709e-e07a-4610-9d10-89e1743549af'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:03 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[3338f7b2-5a37-4a4d-b72e-fc7a52029257]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0879669-78ea-47a0-bd71-cea13753b0ba {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:04 devstack quobyte-client[83246]: System call of process 93977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:49:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.223s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:05 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:49:05 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Deleted volume successfully. Sep 16 22:49:05 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "cinder-94a68877-a216-47ed-8b4a-e518d94be893-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0879669-78ea-47a0-bd71-cea13753b0ba" returned: 0 in 1.753s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0879669-78ea-47a0-bd71-cea13753b0ba {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-94a68877-a216-47ed-8b4a-e518d94be893-delete_volume" acquired by "delete_volume" :: waited 0.554s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c1cc4028-d2bd-4664-a9dd-a844db1e0f0d tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-e14d51b3-ca2e-4682-a867-932a60dcd05d-delete_volume" released by "delete_volume" :: held 4.565s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0879669-78ea-47a0-bd71-cea13753b0ba" returned: 0 in 0.665s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-b0879669-78ea-47a0-bd71-cea13753b0ba" released by "delete_volume" :: held 2.533s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:06 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "cinder-quobyte-94a68877-a216-47ed-8b4a-e518d94be893" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-quobyte-94a68877-a216-47ed-8b4a-e518d94be893" acquired by "delete_volume" :: waited 0.069s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:06 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5bf53c-b465-4b04-9d17-bf2034d42bf2]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-94a68877-a216-47ed-8b4a-e518d94be893 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:07 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created reservations ['dbe91ee7-ee5f-4714-a6f4-73d438a0623d', '07146090-0016-4cec-ac3e-04fdae896660', 'df097e56-54a1-4ab1-be26-23827c16f4f3', 'b4d4fb6e-2668-4296-aefa-f134cccd91bd'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-94a68877-a216-47ed-8b4a-e518d94be893" returned: 0 in 1.129s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-94a68877-a216-47ed-8b4a-e518d94be893 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-94a68877-a216-47ed-8b4a-e518d94be893" returned: 0 in 0.519s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-quobyte-94a68877-a216-47ed-8b4a-e518d94be893" released by "delete_volume" :: held 2.049s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-acd8f11c-adef-4a18-98eb-53a1bd5e44f5-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.668s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-acd8f11c-adef-4a18-98eb-53a1bd5e44f5-delete_volume" acquired by "delete_volume" :: waited 0.218s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:09 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:49:09 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Created reservations ['90f01597-6264-480c-8111-acd388b32f19', '3e9fb497-3630-4a80-9218-233442ed4ee3', '9c628c62-476f-4a36-899e-a126b162f46b', '483f2342-1e98-467f-8958-be2521a431de'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:09 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Deleted volume successfully. Sep 16 22:49:10 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-quobyte-acd8f11c-adef-4a18-98eb-53a1bd5e44f5" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40d179c2-724b-4377-834b-06cf0b116b51 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-b0879669-78ea-47a0-bd71-cea13753b0ba-delete_volume" released by "delete_volume" :: held 6.553s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-acd8f11c-adef-4a18-98eb-53a1bd5e44f5" acquired by "delete_volume" :: waited 0.105s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:10 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7f9eb0-c07d-4956-8289-e062f85083f6]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.100s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.156s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.648s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:11 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:49:11 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Deleted volume successfully. Sep 16 22:49:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5" returned: 0 in 2.030s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6317ad9a-1f36-4ae0-afbb-f69c03a56f63 tempest-CinderUnicodeTest-1812019705 None] Lock "cinder-94a68877-a216-47ed-8b4a-e518d94be893-delete_volume" released by "delete_volume" :: held 6.500s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-acd8f11c-adef-4a18-98eb-53a1bd5e44f5" returned: 0 in 0.382s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-acd8f11c-adef-4a18-98eb-53a1bd5e44f5" released by "delete_volume" :: held 2.484s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:13 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created reservations ['8dbcc4be-48ce-4c7c-9d56-52991f8e550f', '6c19f31d-b09e-45b9-97bc-403eca67a52b', '6d56503c-3bb5-4bbe-af29-ecd25a4fc38d', '080202d4-7434-48a3-bfa8-92449ff4d8ba'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.161s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:13 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:49:13 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Deleted volume successfully. Sep 16 22:49:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f80fff6d-a634-4ab5-ac4c-80ab36f50146 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-acd8f11c-adef-4a18-98eb-53a1bd5e44f5-delete_volume" released by "delete_volume" :: held 4.310s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-2224fae2-416e-4104-8924-4f43dd2ae561-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-2224fae2-416e-4104-8924-4f43dd2ae561-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-quobyte-2224fae2-416e-4104-8924-4f43dd2ae561" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-2224fae2-416e-4104-8924-4f43dd2ae561" acquired by "delete_volume" :: waited 0.024s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:14 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac1a29a-ebbc-43af-a178-28aebd149715]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2224fae2-416e-4104-8924-4f43dd2ae561 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:14 devstack quobyte-client[83246]: System call of process 94004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2224fae2-416e-4104-8924-4f43dd2ae561" returned: 0 in 0.556s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2224fae2-416e-4104-8924-4f43dd2ae561 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2224fae2-416e-4104-8924-4f43dd2ae561" returned: 0 in 0.138s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-2224fae2-416e-4104-8924-4f43dd2ae561" released by "delete_volume" :: held 0.946s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created reservations ['f697f66c-9e7c-49ee-a7fe-eeff1ab313d7', '55d1f983-8f42-47a0-9ee4-fddd62e3b3f7', '3c0f8d61-3cc6-4727-aab2-1b48f1bb59cb', '4dbc0eb0-5f77-40ed-93bf-594556a64ffc'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.131s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:16 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:49:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Deleted volume successfully. Sep 16 22:49:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a27d5353-10f8-4b79-82da-4ce595f53d74 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-2224fae2-416e-4104-8924-4f43dd2ae561-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-9fdf6196-48c7-4550-bde3-2d06ca616df5-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-9fdf6196-48c7-4550-bde3-2d06ca616df5-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:16 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-quobyte-9fdf6196-48c7-4550-bde3-2d06ca616df5" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-9fdf6196-48c7-4550-bde3-2d06ca616df5" acquired by "delete_volume" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:16 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b9a9d8-7b1f-445b-bc83-fe9ebb68775d]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9fdf6196-48c7-4550-bde3-2d06ca616df5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9fdf6196-48c7-4550-bde3-2d06ca616df5" returned: 0 in 0.704s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9fdf6196-48c7-4550-bde3-2d06ca616df5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9fdf6196-48c7-4550-bde3-2d06ca616df5" returned: 0 in 0.265s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-9fdf6196-48c7-4550-bde3-2d06ca616df5" released by "delete_volume" :: held 1.241s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:18 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created reservations ['bfe98cc9-7448-4663-9c5b-71d15f7cc14a', 'ea553c74-d483-4a7b-ad2b-b9e33890fe49', '320327d4-faac-4d6b-a30e-715b87a36b11', '861dbe8c-f2f0-4e3d-94c3-ed90fba6b3a6'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:18 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.219s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:19 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:49:19 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Deleted volume successfully. Sep 16 22:49:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-d7300b4e-f216-4a28-a041-acaaafc547bd-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-78b68085-bb7b-428b-9586-5a9cfa78fc93 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-9fdf6196-48c7-4550-bde3-2d06ca616df5-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-d7300b4e-f216-4a28-a041-acaaafc547bd-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:19 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "cinder-quobyte-d7300b4e-f216-4a28-a041-acaaafc547bd" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-d7300b4e-f216-4a28-a041-acaaafc547bd" acquired by "delete_volume" :: waited 0.020s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:19 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdb3c8f-b457-4f29-8800-e0ed6197474c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d7300b4e-f216-4a28-a041-acaaafc547bd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d7300b4e-f216-4a28-a041-acaaafc547bd" returned: 0 in 0.712s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d7300b4e-f216-4a28-a041-acaaafc547bd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d7300b4e-f216-4a28-a041-acaaafc547bd" returned: 0 in 0.148s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:20 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-quobyte-d7300b4e-f216-4a28-a041-acaaafc547bd" released by "delete_volume" :: held 1.122s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:21 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Created reservations ['09e76907-808e-4f6a-b5b0-c335bcc728a7', '126ebe05-b806-4d53-87a0-5285bf624bd8', 'd9ca37f4-c8bd-4548-83ff-7b52de273497', 'a8a292fd-cf82-4689-a0b7-bf0706009906'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.169s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:21 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:49:21 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Deleted volume successfully. Sep 16 22:49:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e5fe847f-9048-4866-82ba-1ec18f089b43 tempest-CreateVolumesFromSourceVolumeTest-948432797 None] Lock "cinder-d7300b4e-f216-4a28-a041-acaaafc547bd-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:49:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.118s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:49:31 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=61,cinder:SELECT=42,cinder:INSERT=27,cinder:DELETE=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:49:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=34,cinder:INSERT=5,cinder:UPDATE=70,cinder:DELETE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:49:42 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Flow 'volume_create_manager' (7b73208e-dc3d-47fc-8a6b-c00bf6032fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb264ad-72ca-475f-9e19-21a227cc0700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb264ad-72ca-475f-9e19-21a227cc0700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-392395919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68a8323-a1b7-4ab2-a13a-367f1ecdaea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7516c1d923084af3941b7ee1f71e3e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:49:42Z,use_quota=True,user_id='cd914e15018749529f3ec219e7c4ced3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d02e37e-4173-460a-8819-c8113702d5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d02e37e-4173-460a-8819-c8113702d5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0400c056-8599-4ed2-a734-5f7694bff6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0400c056-8599-4ed2-a734-5f7694bff6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68a8323-a1b7-4ab2-a13a-367f1ecdaea3', 'volume_name': 'volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789b4049-436e-4ace-8ec8-83e1af707126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789b4049-436e-4ace-8ec8-83e1af707126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbe1c52-6054-47f5-a813-80c6eaeb48a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:42 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Volume c68a8323-a1b7-4ab2-a13a-367f1ecdaea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3', 'volume_size': 1} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-392395919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68a8323-a1b7-4ab2-a13a-367f1ecdaea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7516c1d923084af3941b7ee1f71e3e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:49:42Z,use_quota=True,user_id='cd914e15018749529f3ec219e7c4ced3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Creating volume c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:49:42 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:49:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:42 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=103, name=volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:49:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 1073741824" returned: 0 in 0.399s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" returned: 0 in 0.112s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] <== create_volume: return (586ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:49:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.609s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbe1c52-6054-47f5-a813-80c6eaeb48a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d21636-ff3f-4137-af3a-718b3c7e8d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:43 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Volume volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 (c68a8323-a1b7-4ab2-a13a-367f1ecdaea3): created successfully Sep 16 22:49:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d21636-ff3f-4137-af3a-718b3c7e8d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Flow 'volume_create_manager' (7b73208e-dc3d-47fc-8a6b-c00bf6032fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:49:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-48a53d5e-b489-4d2c-ba3a-42fa2df74143 tempest-SnapshotDependencyTests-1170362437 None] Created volume successfully. Sep 16 22:49:44 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Creating offline snapshot 2c60b762-496b-4a59-87eb-d59213af08d9 of volume c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 22:49:44 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[189c66cd-71a2-4582-83a8-4855e8cfb76b]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" returned: 0 in 0.397s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:45 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=104, name=volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:49:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 1G" returned: 0 in 0.260s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] CMD "qemu-img rebase -u -b volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9" returned: 0 in 0.137s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:49:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 22:49:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9" returned: 0 in 0.103s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.info" returned: 0 in 0.090s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:46 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:49:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.info" returned: 0 in 0.081s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.504s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:46 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-48a49734-b782-4b70-b10d-d88d8013b175 tempest-SnapshotDependencyTests-1170362437 None] Create snapshot completed successfully Sep 16 22:49:47 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Flow 'volume_create_manager' (01c985f8-90ae-442e-be8f-f45ea52b8731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0553170b-3651-46c3-89e0-d17e7c536a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0553170b-3651-46c3-89e0-d17e7c536a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03730ed-db3e-4401-8c1c-88b623753aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7516c1d923084af3941b7ee1f71e3e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2c60b762-496b-4a59-87eb-d59213af08d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:49:47Z,use_quota=True,user_id='cd914e15018749529f3ec219e7c4ced3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37301a57-4345-4e28-b60d-8ea421184f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37301a57-4345-4e28-b60d-8ea421184f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd2f420-8a4d-4678-9f02-16bbb1c7b985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd2f420-8a4d-4678-9f02-16bbb1c7b985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd03730ed-db3e-4401-8c1c-88b623753aee', 'volume_name': 'volume-d03730ed-db3e-4401-8c1c-88b623753aee', 'volume_size': 1, 'snapshot_id': '2c60b762-496b-4a59-87eb-d59213af08d9'}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea193444-9102-46e8-a101-6733d5f88a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea193444-9102-46e8-a101-6733d5f88a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd4e34b-cc50-4c9b-827f-fdb6fbc92d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:47 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Volume d03730ed-db3e-4401-8c1c-88b623753aee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d03730ed-db3e-4401-8c1c-88b623753aee', 'volume_size': 1, 'snapshot_id': '2c60b762-496b-4a59-87eb-d59213af08d9'} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "cinder-quobyte-2c60b762-496b-4a59-87eb-d59213af08d9-d03730ed-db3e-4401-8c1c-88b623753aee" by "_create_volume_from_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-2c60b762-496b-4a59-87eb-d59213af08d9-d03730ed-db3e-4401-8c1c-88b623753aee" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Creating volume d03730ed-db3e-4401-8c1c-88b623753aee from snapshot 2c60b762-496b-4a59-87eb-d59213af08d9 {{(pid=83223) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "cinder-quobyte-d03730ed-db3e-4401-8c1c-88b623753aee" by "_copy_volume_from_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-d03730ed-db3e-4401-8c1c-88b623753aee" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] snapshot: 2c60b762-496b-4a59-87eb-d59213af08d9, volume: d03730ed-db3e-4401-8c1c-88b623753aee, {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bfcfc6-f1c9-4d5f-ab01-e7f2f901a9b4]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9" returned: 0 in 0.390s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:49:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 16 22:49:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Creating direct copy from snapshot {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 16 22:49:48 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f435966-e133-4c20-8933-f4b2cfa5ff8d]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" returned: 0 in 0.375s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:48 devstack cinder-volume[83223]: DEBUG cinder.utils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee not found in is_blk_device check {{(pid=83223) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 22:49:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:48 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=106, name=volume-d03730ed-db3e-4401-8c1c-88b623753aee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:49:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee" returned: 0 in 5.787s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:54 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40199c3-9820-4a95-aaf7-c1bc52e62e99]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" returned: 0 in 0.593s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:54 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 22:49:54 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Converted 1024.00 MB image at 176.20 MB/s Sep 16 22:49:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-d03730ed-db3e-4401-8c1c-88b623753aee" released by "_copy_volume_from_snapshot" :: held 7.581s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-2c60b762-496b-4a59-87eb-d59213af08d9-d03730ed-db3e-4401-8c1c-88b623753aee" released by "_create_volume_from_snapshot" :: held 7.616s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.637s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd4e34b-cc50-4c9b-827f-fdb6fbc92d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03730ed-db3e-4401-8c1c-88b623753aee', 'volume_size': 1, 'snapshot_id': '2c60b762-496b-4a59-87eb-d59213af08d9'}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d911b9a2-1bcd-455b-a01f-ae11dee5063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:49:55 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Volume volume-d03730ed-db3e-4401-8c1c-88b623753aee (d03730ed-db3e-4401-8c1c-88b623753aee): created successfully Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d911b9a2-1bcd-455b-a01f-ae11dee5063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Flow 'volume_create_manager' (01c985f8-90ae-442e-be8f-f45ea52b8731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:49:55 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3180aec4-f9b0-4d5d-98fb-b0d06e8f130b tempest-SnapshotDependencyTests-1170362437 None] Created volume successfully. Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "cinder-2c60b762-496b-4a59-87eb-d59213af08d9-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-2c60b762-496b-4a59-87eb-d59213af08d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:55 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "cinder-quobyte-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "cinder-quobyte-2c60b762-496b-4a59-87eb-d59213af08d9" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-2c60b762-496b-4a59-87eb-d59213af08d9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Deleting offline snapshot 2c60b762-496b-4a59-87eb-d59213af08d9 of volume c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 22:49:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] snapshot_file for this snap is: volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 22:49:56 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae95a7d2-25ef-437c-97af-f60036a9f878]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:56 devstack quobyte-client[83246]: System call of process 94139 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:49:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9" returned: 0 in 0.412s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 22:49:56 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cf0712-fad9-4400-9a11-9d69288f3bab]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" returned: 0 in 0.419s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9" returned: 0 in 0.211s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3.2c60b762-496b-4a59-87eb-d59213af08d9" returned: 0 in 0.106s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-2c60b762-496b-4a59-87eb-d59213af08d9" released by "_delete_snapshot" :: held 1.443s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" released by "delete_snapshot" :: held 1.468s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:57 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Created reservations ['f0f7da87-6ba4-4385-b893-7a36e45105c0', 'e791d6d8-3bf6-43ee-acd4-6285cf6b41bb', '0973b6ce-8bbe-4477-a9c3-9555357d67d2', 'e7d2c10e-03a1-428c-b047-a979b0509baa'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:57 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Delete snapshot completed successfully. Sep 16 22:49:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-412a12ed-7b17-4b6b-b08c-7b0df582bb34 tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-2c60b762-496b-4a59-87eb-d59213af08d9-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "cinder-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:58 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:49:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "cinder-quobyte-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:49:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:49:58 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba96f9f9-584e-4755-a762-8cab548ea3f1]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:49:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" returned: 0 in 0.410s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" returned: 0 in 0.118s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3" released by "delete_volume" :: held 0.693s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:49:59 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Created reservations ['51678313-6836-4e5f-afd9-83d8969ddaaf', '28119b30-e87d-4664-aa41-1438cf0c10d7', '6d4bdd3b-1efb-49d6-a8b5-535ef6f926a1', 'c997389c-f28e-49b1-a949-1162432ffeb3'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:49:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:49:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:49:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:49:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:49:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:49:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:49:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.107s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:49:59 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:49:59 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Deleted volume successfully. Sep 16 22:49:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9ad168f0-e13f-4ab2-abca-125077d3950d tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-c68a8323-a1b7-4ab2-a13a-367f1ecdaea3-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:50:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "cinder-d03730ed-db3e-4401-8c1c-88b623753aee-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:50:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-d03730ed-db3e-4401-8c1c-88b623753aee-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:50:00 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:50:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "cinder-quobyte-d03730ed-db3e-4401-8c1c-88b623753aee" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:50:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-d03730ed-db3e-4401-8c1c-88b623753aee" acquired by "delete_volume" :: waited 0.013s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:50:00 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdc3d68-25b7-40ff-b39e-92c8673a2638]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:50:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee" returned: 0 in 0.410s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-d03730ed-db3e-4401-8c1c-88b623753aee" returned: 0 in 0.114s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-quobyte-d03730ed-db3e-4401-8c1c-88b623753aee" released by "delete_volume" :: held 0.673s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Created reservations ['c6fbcd12-8258-41c6-8b25-310defc1383f', '0162cec1-3eaf-4a8f-98b5-189380ac937f', 'a0278f04-491e-4873-bdbc-4129398aa9b1', 'a3c58487-8cb8-4fe9-9b54-147f234acede'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.117s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:50:01 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:50:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Deleted volume successfully. Sep 16 22:50:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-fdf7914c-71ed-4572-860c-aeedfcf39a44 tempest-SnapshotDependencyTests-1170362437 None] Lock "cinder-d03730ed-db3e-4401-8c1c-88b623753aee-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:50:11 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=11 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:50:11 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=17,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:50:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:50:14 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Flow 'volume_create_manager' (bbdc407f-8e88-4436-808e-faedf850de8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abcd499-1d18-4353-8cad-a397c476b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abcd499-1d18-4353-8cad-a397c476b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-961989005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3ffa93-d58f-4694-8187-9632d1339e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9210752066de4c5ca6d2c08c5cc7975f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:50:15Z,use_quota=True,user_id='da0815644dee474fb196377709ee5a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d0c6b8-9a3e-4faa-8e56-f4ecdcf39d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d0c6b8-9a3e-4faa-8e56-f4ecdcf39d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bbbf83-b026-4079-a898-52b84a171254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bbbf83-b026-4079-a898-52b84a171254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3ffa93-d58f-4694-8187-9632d1339e0a', 'volume_name': 'volume-1a3ffa93-d58f-4694-8187-9632d1339e0a', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be10ebd7-92c0-4bcf-bc97-9a68d8c5b122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be10ebd7-92c0-4bcf-bc97-9a68d8c5b122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c434c3b7-52b6-4c7c-912d-9636853d87e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:50:15 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume 1a3ffa93-d58f-4694-8187-9632d1339e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3ffa93-d58f-4694-8187-9632d1339e0a', 'volume_size': 1} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-961989005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3ffa93-d58f-4694-8187-9632d1339e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9210752066de4c5ca6d2c08c5cc7975f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:50:15Z,use_quota=True,user_id='da0815644dee474fb196377709ee5a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Creating volume 1a3ffa93-d58f-4694-8187-9632d1339e0a {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:50:15 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1a3ffa93-d58f-4694-8187-9632d1339e0a 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:50:15 devstack quobyte-client[83246]: System call of process 94188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 22:50:15 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=107, name=volume-1a3ffa93-d58f-4694-8187-9632d1339e0a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1a3ffa93-d58f-4694-8187-9632d1339e0a 1073741824" returned: 0 in 0.389s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1a3ffa93-d58f-4694-8187-9632d1339e0a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1a3ffa93-d58f-4694-8187-9632d1339e0a" returned: 0 in 0.089s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] <== create_volume: return (568ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.582s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c434c3b7-52b6-4c7c-912d-9636853d87e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3ffa93-d58f-4694-8187-9632d1339e0a', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8826bfc0-9ee6-4a45-b69e-0bcf0f4d68e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:50:15 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume volume-1a3ffa93-d58f-4694-8187-9632d1339e0a (1a3ffa93-d58f-4694-8187-9632d1339e0a): created successfully Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8826bfc0-9ee6-4a45-b69e-0bcf0f4d68e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:50:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Flow 'volume_create_manager' (bbdc407f-8e88-4436-808e-faedf850de8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:50:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-f5cd889c-f01a-4ff3-94fa-a6c4cfca17b2 tempest-AttachVolumeShelveTestJSON-1626356156 None] Created volume successfully. Sep 16 22:50:26 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:50:26 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:50:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:50:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:50:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:50:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:50:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:50:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:50:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:50:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.080s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:50:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:50:32 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2f14eeb7-f684-4de8-b6e3-c552da18300b req-09ff051b-e919-47ef-b847-b20615c88404 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:50:33 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-2f14eeb7-f684-4de8-b6e3-c552da18300b req-09ff051b-e919-47ef-b847-b20615c88404 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:50:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-2f14eeb7-f684-4de8-b6e3-c552da18300b req-09ff051b-e919-47ef-b847-b20615c88404 tempest-AttachVolumeShelveTestJSON-1626356156 None] No connector for attachment d8095845-9ac2-4b56-b430-229437ca8fa1; skipping storage backend terminate_connection call. {{(pid=83223) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 16 22:50:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-2f14eeb7-f684-4de8-b6e3-c552da18300b req-09ff051b-e919-47ef-b847-b20615c88404 tempest-AttachVolumeShelveTestJSON-1626356156 None] Deleting attachment d8095845-9ac2-4b56-b430-229437ca8fa1. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:50:43 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:50:43 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:51:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:51:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:51:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:51:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:51:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:51:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:51:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:51:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.088s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:51:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:51:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:51:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:52:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "cinder-1a3ffa93-d58f-4694-8187-9632d1339e0a-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:52:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "cinder-1a3ffa93-d58f-4694-8187-9632d1339e0a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:52:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:52:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "cinder-quobyte-1a3ffa93-d58f-4694-8187-9632d1339e0a" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:52:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "cinder-quobyte-1a3ffa93-d58f-4694-8187-9632d1339e0a" acquired by "delete_volume" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:52:15 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af9eeba-5202-4888-ad73-e0906a032e12]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:52:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1a3ffa93-d58f-4694-8187-9632d1339e0a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:52:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1a3ffa93-d58f-4694-8187-9632d1339e0a" returned: 0 in 0.405s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:52:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1a3ffa93-d58f-4694-8187-9632d1339e0a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:52:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-1a3ffa93-d58f-4694-8187-9632d1339e0a" returned: 0 in 0.096s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:52:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "cinder-quobyte-1a3ffa93-d58f-4694-8187-9632d1339e0a" released by "delete_volume" :: held 0.645s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:52:15 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Created reservations ['fb969c02-e6e2-4123-8dac-785d9acf791f', 'a67892c0-7df9-4088-94d8-c9d79675f60e', '1d56d011-63d4-4948-982c-2fa30efccb2b', '251c4c87-bede-47a5-ad1f-58a4f4d57332'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.089s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:52:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Deleted volume successfully. Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "cinder-17440d77-82a1-4bbb-9e17-5ffe3658f36f-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-881648fd-e678-4289-9986-7e7b11ca8b84 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "cinder-1a3ffa93-d58f-4694-8187-9632d1339e0a-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "cinder-17440d77-82a1-4bbb-9e17-5ffe3658f36f-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:52:16 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "cinder-quobyte-17440d77-82a1-4bbb-9e17-5ffe3658f36f" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "cinder-quobyte-17440d77-82a1-4bbb-9e17-5ffe3658f36f" acquired by "delete_volume" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8959d065-d173-447d-902e-3961d9863641]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:52:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f" returned: 0 in 0.382s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-17440d77-82a1-4bbb-9e17-5ffe3658f36f" returned: 0 in 0.095s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "cinder-quobyte-17440d77-82a1-4bbb-9e17-5ffe3658f36f" released by "delete_volume" :: held 0.612s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Created reservations ['01523485-faf1-4122-9e26-ef0b9ce8351d', '9d4e6350-4499-4d0e-a11e-860388c11f17', 'f6b8c969-6c12-4080-b208-ecb48f0b7e15', 'c8766358-6bfb-46a7-b09a-5fe823227e3e'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.100s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:52:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Deleted volume successfully. Sep 16 22:52:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ff6fc25-e0cd-4c46-9880-337596530313 tempest-AttachVolumeShelveTestJSON-1626356156 None] Lock "cinder-17440d77-82a1-4bbb-9e17-5ffe3658f36f-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 22:52:27 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:52:27 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=18,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:52:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:52:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:52:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:52:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:52:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:52:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:52:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:52:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.100s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:52:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:53:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:53:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:53:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:53:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:53:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:53:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:53:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:53:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.098s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:53:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:53:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:53:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:54:05 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Flow 'volume_create_manager' (b8aaecdf-764f-4028-8b11-68a6d2ac3b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e81cdf8-fa70-40ae-ad33-458abb1fd0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e81cdf8-fa70-40ae-ad33-458abb1fd0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1294226013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24314ec0-c394-424d-af7a-3fe892132191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3151f4a90d49b68b931a425590c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:54:05Z,use_quota=True,user_id='d213aa48c63f4fcf9aca0d05aec66b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a043def-7e5c-46eb-a40e-714be8c2c22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a043def-7e5c-46eb-a40e-714be8c2c22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1036795e-cc05-4d7e-b3cd-76abae6b5a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1036795e-cc05-4d7e-b3cd-76abae6b5a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24314ec0-c394-424d-af7a-3fe892132191', 'volume_name': 'volume-24314ec0-c394-424d-af7a-3fe892132191', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa06f72-08d8-4def-a229-dc290f1813c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa06f72-08d8-4def-a229-dc290f1813c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07ddac8-6569-4861-8985-bcc05cce7ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:54:05 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Volume 24314ec0-c394-424d-af7a-3fe892132191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24314ec0-c394-424d-af7a-3fe892132191', 'volume_size': 1} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1294226013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24314ec0-c394-424d-af7a-3fe892132191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3151f4a90d49b68b931a425590c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:54:05Z,use_quota=True,user_id='d213aa48c63f4fcf9aca0d05aec66b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Creating volume 24314ec0-c394-424d-af7a-3fe892132191 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:54:05 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-24314ec0-c394-424d-af7a-3fe892132191 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:54:05 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=108, name=volume-24314ec0-c394-424d-af7a-3fe892132191, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-24314ec0-c394-424d-af7a-3fe892132191 1073741824" returned: 0 in 0.361s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-24314ec0-c394-424d-af7a-3fe892132191 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:54:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-24314ec0-c394-424d-af7a-3fe892132191" returned: 0 in 0.082s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:54:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] <== create_volume: return (524ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:54:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.536s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:54:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07ddac8-6569-4861-8985-bcc05cce7ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24314ec0-c394-424d-af7a-3fe892132191', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:54:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00394fa-0a4f-4643-9f9b-0664b7daa125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:54:06 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Volume volume-24314ec0-c394-424d-af7a-3fe892132191 (24314ec0-c394-424d-af7a-3fe892132191): created successfully Sep 16 22:54:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00394fa-0a4f-4643-9f9b-0664b7daa125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:54:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Flow 'volume_create_manager' (b8aaecdf-764f-4028-8b11-68a6d2ac3b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:54:06 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-10e949f2-93ec-4c9b-9bac-0d08a8772791 tempest-AttachVolumeTestJSON-1272417894 None] Created volume successfully. Sep 16 22:54:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-9a428765-0d85-40c5-b202-bcf43c87615c req-853d30fe-9751-4fba-b972-94bd7d956bbb tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:54:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-9a428765-0d85-40c5-b202-bcf43c87615c req-853d30fe-9751-4fba-b972-94bd7d956bbb tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:54:11 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1e0267-0c76-4892-ae1a-e62c58db73ac]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:54:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-9a428765-0d85-40c5-b202-bcf43c87615c req-853d30fe-9751-4fba-b972-94bd7d956bbb tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-24314ec0-c394-424d-af7a-3fe892132191 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:54:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-9a428765-0d85-40c5-b202-bcf43c87615c req-853d30fe-9751-4fba-b972-94bd7d956bbb tempest-AttachVolumeTestJSON-1272417894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-24314ec0-c394-424d-af7a-3fe892132191" returned: 0 in 0.374s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:54:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-9a428765-0d85-40c5-b202-bcf43c87615c req-853d30fe-9751-4fba-b972-94bd7d956bbb tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.429s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:54:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-9a428765-0d85-40c5-b202-bcf43c87615c req-853d30fe-9751-4fba-b972-94bd7d956bbb tempest-AttachVolumeTestJSON-1272417894 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-24314ec0-c394-424d-af7a-3fe892132191', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f65ae89-d130-4041-8396-f18baf92e721', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:54:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-9a428765-0d85-40c5-b202-bcf43c87615c req-853d30fe-9751-4fba-b972-94bd7d956bbb tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:54:11 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-9a428765-0d85-40c5-b202-bcf43c87615c req-853d30fe-9751-4fba-b972-94bd7d956bbb tempest-AttachVolumeTestJSON-1272417894 None] attachment_update completed successfully. Sep 16 22:54:21 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:54:21 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:54:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:54:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:54:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:54:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:54:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:54:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:54:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:54:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.080s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:54:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:55:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:55:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:55:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:55:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:55:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:55:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:55:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:55:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.099s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:55:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:55:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:56:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-018ef359-0b96-48e2-845d-4fe5de795d9f req-e84e7a1c-9b00-43fb-abd3-2837f678ab94 tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:56:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-018ef359-0b96-48e2-845d-4fe5de795d9f req-e84e7a1c-9b00-43fb-abd3-2837f678ab94 tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:56:07 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-018ef359-0b96-48e2-845d-4fe5de795d9f req-e84e7a1c-9b00-43fb-abd3-2837f678ab94 tempest-AttachVolumeTestJSON-1272417894 None] Terminate volume connection completed successfully. Sep 16 22:56:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-018ef359-0b96-48e2-845d-4fe5de795d9f req-e84e7a1c-9b00-43fb-abd3-2837f678ab94 tempest-AttachVolumeTestJSON-1272417894 None] Deleting attachment 6f65ae89-d130-4041-8396-f18baf92e721. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 22:56:17 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:56:17 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:56:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:56:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:56:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:56:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:56:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:56:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:56:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:56:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:56:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:57:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:57:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:57:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:57:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:57:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:57:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:57:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:57:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.081s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:57:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:57:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:57:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:58:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:58:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:58:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:58:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:58:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:58:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:58:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:58:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.083s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:58:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:59:16 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Flow 'volume_create_manager' (262fc155-587c-46fc-bb62-becac1ab8517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db47df0-67f0-4ed6-8841-c10209d3d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db47df0-67f0-4ed6-8841-c10209d3d06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-449778377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9350a289-aa8b-4d7d-be57-d25c8c2d7376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3151f4a90d49b68b931a425590c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:59:16Z,use_quota=True,user_id='d213aa48c63f4fcf9aca0d05aec66b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4ecfda-e9e2-4a21-a7da-493e181bb434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4ecfda-e9e2-4a21-a7da-493e181bb434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538ed54a-c006-4b8b-ad65-23274eedcc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538ed54a-c006-4b8b-ad65-23274eedcc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9350a289-aa8b-4d7d-be57-d25c8c2d7376', 'volume_name': 'volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5604be6a-2123-47d5-84b6-c3612356b6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5604be6a-2123-47d5-84b6-c3612356b6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c60b77-4930-43bd-95af-6c03ace03d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:16 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Volume 9350a289-aa8b-4d7d-be57-d25c8c2d7376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376', 'volume_size': 1} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-449778377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9350a289-aa8b-4d7d-be57-d25c8c2d7376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3151f4a90d49b68b931a425590c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:59:16Z,use_quota=True,user_id='d213aa48c63f4fcf9aca0d05aec66b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Creating volume 9350a289-aa8b-4d7d-be57-d25c8c2d7376 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:59:16 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:59:16 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=109, name=volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376 1073741824" returned: 0 in 0.357s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376" returned: 0 in 0.077s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] <== create_volume: return (498ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.511s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c60b77-4930-43bd-95af-6c03ace03d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eecd8a3-fd47-4ddf-b644-83d097ab38e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:17 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Volume volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376 (9350a289-aa8b-4d7d-be57-d25c8c2d7376): created successfully Sep 16 22:59:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eecd8a3-fd47-4ddf-b644-83d097ab38e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Flow 'volume_create_manager' (262fc155-587c-46fc-bb62-becac1ab8517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:59:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ba28c8f1-6b33-44dc-9cff-7a22815d85ac tempest-AttachVolumeTestJSON-1272417894 None] Created volume successfully. Sep 16 22:59:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-1481ceb3-d550-45c3-838a-79486a64995b req-9ca49560-f143-400c-9e96-a1125c82bf7a tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:59:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-1481ceb3-d550-45c3-838a-79486a64995b req-9ca49560-f143-400c-9e96-a1125c82bf7a tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:59:21 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8860238-a257-4461-b6a2-1c9e82e3685a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:59:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-1481ceb3-d550-45c3-838a-79486a64995b req-9ca49560-f143-400c-9e96-a1125c82bf7a tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:59:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-1481ceb3-d550-45c3-838a-79486a64995b req-9ca49560-f143-400c-9e96-a1125c82bf7a tempest-AttachVolumeTestJSON-1272417894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376" returned: 0 in 0.387s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:59:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-1481ceb3-d550-45c3-838a-79486a64995b req-9ca49560-f143-400c-9e96-a1125c82bf7a tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.442s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:59:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-1481ceb3-d550-45c3-838a-79486a64995b req-9ca49560-f143-400c-9e96-a1125c82bf7a tempest-AttachVolumeTestJSON-1272417894 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '404f4ce3-139a-4d1f-81c9-be45007540c7', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:59:22 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-1481ceb3-d550-45c3-838a-79486a64995b req-9ca49560-f143-400c-9e96-a1125c82bf7a tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:59:22 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-1481ceb3-d550-45c3-838a-79486a64995b req-9ca49560-f143-400c-9e96-a1125c82bf7a tempest-AttachVolumeTestJSON-1272417894 None] attachment_update completed successfully. Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.349s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 22:59:28 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Flow 'volume_create_manager' (ba017df9-d67e-4399-b83d-cb3c0edd422d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:59:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d76c6e0-4a7e-4145-86c2-045f9d1b5266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d76c6e0-4a7e-4145-86c2-045f9d1b5266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1038857103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30e9ae4-2a63-4093-8d3a-53d9bb569ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3151f4a90d49b68b931a425590c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:59:28Z,use_quota=True,user_id='d213aa48c63f4fcf9aca0d05aec66b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078e7fcf-d2a0-457a-8e61-eb936a77a138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078e7fcf-d2a0-457a-8e61-eb936a77a138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ca1551-68f5-40dc-8a3b-e4e9fc6cf74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ca1551-68f5-40dc-8a3b-e4e9fc6cf74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f30e9ae4-2a63-4093-8d3a-53d9bb569ca0', 'volume_name': 'volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628d3270-b91f-413f-b2ab-7d07acf75199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628d3270-b91f-413f-b2ab-7d07acf75199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6674e37a-2c37-49b9-9db5-a3453a09a95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:29 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Volume f30e9ae4-2a63-4093-8d3a-53d9bb569ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0', 'volume_size': 1} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T20:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1038857103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30e9ae4-2a63-4093-8d3a-53d9bb569ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3151f4a90d49b68b931a425590c710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T20:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T20:59:28Z,use_quota=True,user_id='d213aa48c63f4fcf9aca0d05aec66b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Creating volume f30e9ae4-2a63-4093-8d3a-53d9bb569ca0 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 22:59:29 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:59:29 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=110, name=volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0 1073741824" returned: 0 in 0.296s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] <== create_volume: return (452ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.465s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6674e37a-2c37-49b9-9db5-a3453a09a95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f924bfac-8370-43cd-b351-fd079f4b865b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 22:59:29 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Volume volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0 (f30e9ae4-2a63-4093-8d3a-53d9bb569ca0): created successfully Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f924bfac-8370-43cd-b351-fd079f4b865b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 22:59:29 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Flow 'volume_create_manager' (ba017df9-d67e-4399-b83d-cb3c0edd422d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 22:59:29 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-2e3a1439-e519-4c97-bae6-4fffb99949e5 tempest-AttachVolumeTestJSON-1272417894 None] Created volume successfully. Sep 16 22:59:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-c2b4d1b3-f196-4b32-b954-fc000bae8e1a req-58393a96-eda1-4db9-b402-d89009c75641 tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 22:59:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-c2b4d1b3-f196-4b32-b954-fc000bae8e1a req-58393a96-eda1-4db9-b402-d89009c75641 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 22:59:34 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6582805-63ac-4cef-a47a-8a64cbd80a65]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 22:59:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-c2b4d1b3-f196-4b32-b954-fc000bae8e1a req-58393a96-eda1-4db9-b402-d89009c75641 tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 22:59:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-c2b4d1b3-f196-4b32-b954-fc000bae8e1a req-58393a96-eda1-4db9-b402-d89009c75641 tempest-AttachVolumeTestJSON-1272417894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0" returned: 0 in 0.396s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 22:59:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-c2b4d1b3-f196-4b32-b954-fc000bae8e1a req-58393a96-eda1-4db9-b402-d89009c75641 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.449s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 22:59:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-c2b4d1b3-f196-4b32-b954-fc000bae8e1a req-58393a96-eda1-4db9-b402-d89009c75641 tempest-AttachVolumeTestJSON-1272417894 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '033bab2b-b91e-407e-9fac-a1bc2aa09ed2', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 22:59:34 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-c2b4d1b3-f196-4b32-b954-fc000bae8e1a req-58393a96-eda1-4db9-b402-d89009c75641 tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 22:59:35 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-c2b4d1b3-f196-4b32-b954-fc000bae8e1a req-58393a96-eda1-4db9-b402-d89009c75641 tempest-AttachVolumeTestJSON-1272417894 None] attachment_update completed successfully. Sep 16 22:59:45 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 22:59:45 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=6,cinder:DELETE=1,cinder:SELECT=17 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:00:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-6ea09b98-f955-415e-a745-be6a23359f72 req-593f03c4-d0fc-455d-bc3b-3faeb0fc8582 tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-6ea09b98-f955-415e-a745-be6a23359f72 req-593f03c4-d0fc-455d-bc3b-3faeb0fc8582 tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:02 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-6ea09b98-f955-415e-a745-be6a23359f72 req-593f03c4-d0fc-455d-bc3b-3faeb0fc8582 tempest-AttachVolumeTestJSON-1272417894 None] Terminate volume connection completed successfully. Sep 16 23:00:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-6ea09b98-f955-415e-a745-be6a23359f72 req-593f03c4-d0fc-455d-bc3b-3faeb0fc8582 tempest-AttachVolumeTestJSON-1272417894 None] Deleting attachment 404f4ce3-139a-4d1f-81c9-be45007540c7. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 23:00:12 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:00:12 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:00:25 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-4d1d4ef6-3728-4ca4-9772-43a8cb961915 req-dbbd4052-1cb8-450a-9367-a6fc12295f41 tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:25 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-4d1d4ef6-3728-4ca4-9772-43a8cb961915 req-dbbd4052-1cb8-450a-9367-a6fc12295f41 tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:25 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-4d1d4ef6-3728-4ca4-9772-43a8cb961915 req-dbbd4052-1cb8-450a-9367-a6fc12295f41 tempest-AttachVolumeTestJSON-1272417894 None] Terminate volume connection completed successfully. Sep 16 23:00:25 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-4d1d4ef6-3728-4ca4-9772-43a8cb961915 req-dbbd4052-1cb8-450a-9367-a6fc12295f41 tempest-AttachVolumeTestJSON-1272417894 None] Deleting attachment 033bab2b-b91e-407e-9fac-a1bc2aa09ed2. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 23:00:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:00:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:00:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:00:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:00:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:00:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:00:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.082s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:00:35 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:00:35 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:00:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "cinder-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:39 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "cinder-quobyte-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-quobyte-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0" acquired by "delete_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:39 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3ce824-5da0-4f65-93d5-da315ca34b11]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:00:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0" returned: 0 in 0.423s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0" returned: 0 in 0.096s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-quobyte-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0" released by "delete_volume" :: held 0.666s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Created reservations ['0ea907d1-5a52-4796-863e-08252d781308', 'b942e5f2-1601-401c-983c-fb229553aed0', '2db8410c-72b3-4c32-9ec6-72faeb1a05e6', '20830537-9ea1-453b-bf57-dfc6bcf1f74f'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:40 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:00:40 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Deleted volume successfully. Sep 16 23:00:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-507c72ce-63a2-4bb1-83e8-1b713b73393f tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-f30e9ae4-2a63-4093-8d3a-53d9bb569ca0-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:00:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "cinder-9350a289-aa8b-4d7d-be57-d25c8c2d7376-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-9350a289-aa8b-4d7d-be57-d25c8c2d7376-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:41 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "cinder-quobyte-9350a289-aa8b-4d7d-be57-d25c8c2d7376" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-quobyte-9350a289-aa8b-4d7d-be57-d25c8c2d7376" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:41 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[2608fb81-05c5-46b3-be00-09bf7ca0983a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:00:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376" returned: 0 in 0.388s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9350a289-aa8b-4d7d-be57-d25c8c2d7376" returned: 0 in 0.107s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-quobyte-9350a289-aa8b-4d7d-be57-d25c8c2d7376" released by "delete_volume" :: held 0.627s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Created reservations ['be3f7245-2adf-4bf0-97e6-bdcd155be936', '3fb76f08-e71a-4099-86d2-3beb61e78f0b', '810da483-8def-422d-9eee-e7459d646f17', '0bcdb631-bd64-4bf8-ba08-de30e6a08143'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.098s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:42 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:00:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Deleted volume successfully. Sep 16 23:00:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0bd7881f-9c95-4001-9c9d-3fc2f7bb6084 tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-9350a289-aa8b-4d7d-be57-d25c8c2d7376-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:00:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "cinder-24314ec0-c394-424d-af7a-3fe892132191-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-24314ec0-c394-424d-af7a-3fe892132191-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:44 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "cinder-quobyte-24314ec0-c394-424d-af7a-3fe892132191" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-quobyte-24314ec0-c394-424d-af7a-3fe892132191" acquired by "delete_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:44 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7252b8-d432-4582-a7c6-b896233688e3]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:00:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-24314ec0-c394-424d-af7a-3fe892132191 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-24314ec0-c394-424d-af7a-3fe892132191" returned: 0 in 0.385s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-24314ec0-c394-424d-af7a-3fe892132191 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-24314ec0-c394-424d-af7a-3fe892132191" returned: 0 in 0.109s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-quobyte-24314ec0-c394-424d-af7a-3fe892132191" released by "delete_volume" :: held 0.635s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:00:44 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Created reservations ['a463d089-df6b-411c-aad0-a2e5900f3222', 'e6a520fd-874d-4bb4-bb08-291ecc74b2a5', 'c6c8be86-9382-4284-8e53-cda3c5f19fe3', 'c9f27e39-e490-4c2c-8904-94b97be6ff0c'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:00:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:00:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:00:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:00:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:00:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:00:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.111s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:45 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:00:45 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Deleted volume successfully. Sep 16 23:00:45 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-15a55f83-e8ca-435e-92c0-3d681733fd0c tempest-AttachVolumeTestJSON-1272417894 None] Lock "cinder-24314ec0-c394-424d-af7a-3fe892132191-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:00:53 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Flow 'volume_create_manager' (09bee520-2610-4e67-a2e7-f5b423579f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7316a26-7a0c-4f6d-ba44-55f063629604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7316a26-7a0c-4f6d-ba44-55f063629604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2114117599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bf09a1-2b53-4c74-9767-8b782040b03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c758f44faf45349534a2d27edda9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:00:53Z,use_quota=True,user_id='0bec921367914784908cc2b14b8c89ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb8f4c6-7d5b-414d-a2e0-cbb1a54e3c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb8f4c6-7d5b-414d-a2e0-cbb1a54e3c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb231a2-7e43-4f91-a36c-c0d240f9cb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb231a2-7e43-4f91-a36c-c0d240f9cb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16bf09a1-2b53-4c74-9767-8b782040b03a', 'volume_name': 'volume-16bf09a1-2b53-4c74-9767-8b782040b03a', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc33307-4d21-4671-85e8-71cd797c0e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc33307-4d21-4671-85e8-71cd797c0e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef262952-effb-4f48-b667-0388471d35a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:00:53 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Volume 16bf09a1-2b53-4c74-9767-8b782040b03a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16bf09a1-2b53-4c74-9767-8b782040b03a', 'volume_size': 1} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2114117599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bf09a1-2b53-4c74-9767-8b782040b03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8c758f44faf45349534a2d27edda9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:00:53Z,use_quota=True,user_id='0bec921367914784908cc2b14b8c89ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Creating volume 16bf09a1-2b53-4c74-9767-8b782040b03a {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:00:53 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:00:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:53 devstack quobyte-client[83246]: System call of process 97340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:00:53 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=111, name=volume-16bf09a1-2b53-4c74-9767-8b782040b03a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a 1073741824" returned: 0 in 0.331s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a" returned: 0 in 0.091s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] <== create_volume: return (480ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.492s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef262952-effb-4f48-b667-0388471d35a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16bf09a1-2b53-4c74-9767-8b782040b03a', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b24f2a2-fd47-47f3-bae8-4f73d27bac02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:00:54 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Volume volume-16bf09a1-2b53-4c74-9767-8b782040b03a (16bf09a1-2b53-4c74-9767-8b782040b03a): created successfully Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b24f2a2-fd47-47f3-bae8-4f73d27bac02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Flow 'volume_create_manager' (09bee520-2610-4e67-a2e7-f5b423579f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:00:54 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-0c19d723-e332-420e-af8e-64c3caa82131 req-65944904-1b5f-4b95-b5ff-1ea8ded421f7 tempest-VolumesSnapshotsTestJSON-770884569 None] Created volume successfully. Sep 16 23:00:54 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Creating offline snapshot db19eb0f-da8f-4876-b334-49d54c715543 of volume 16bf09a1-2b53-4c74-9767-8b782040b03a {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d560c32-4cf0-4448-8fb3-b46dd66770f0]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:00:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a" returned: 0 in 0.376s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:55 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=112, name=volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:00:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543 1G" returned: 0 in 0.217s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): qemu-img rebase -u -b volume-16bf09a1-2b53-4c74-9767-8b782040b03a -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "qemu-img rebase -u -b volume-16bf09a1-2b53-4c74-9767-8b782040b03a -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543" returned: 0 in 0.121s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:00:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 23:00:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543" returned: 0 in 0.099s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.info" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:00:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.info" returned: 0 in 0.081s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.421s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:00:56 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-cc617981-5e24-4460-b712-b3f6fc2cc2b8 req-43a8bc10-1c75-491c-8561-0157c1bb792f tempest-VolumesSnapshotsTestJSON-770884569 None] Create snapshot completed successfully Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Acquiring lock "cinder-db19eb0f-da8f-4876-b334-49d54c715543-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "cinder-db19eb0f-da8f-4876-b334-49d54c715543-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Acquiring lock "cinder-quobyte-16bf09a1-2b53-4c74-9767-8b782040b03a" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "cinder-quobyte-16bf09a1-2b53-4c74-9767-8b782040b03a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Acquiring lock "cinder-quobyte-db19eb0f-da8f-4876-b334-49d54c715543" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "cinder-quobyte-db19eb0f-da8f-4876-b334-49d54c715543" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Deleting offline snapshot db19eb0f-da8f-4876-b334-49d54c715543 of volume 16bf09a1-2b53-4c74-9767-8b782040b03a {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] snapshot_file for this snap is: volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[292e5915-f06a-4191-8e8e-690965502635]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543" returned: 0 in 0.367s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16bf09a1-2b53-4c74-9767-8b782040b03a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[7028fd61-6234-4722-8bba-de07e3f300ee]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:00:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a" returned: 0 in 0.391s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543" returned: 0 in 0.217s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:00:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a.db19eb0f-da8f-4876-b334-49d54c715543" returned: 0 in 0.082s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:00:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "cinder-quobyte-db19eb0f-da8f-4876-b334-49d54c715543" released by "_delete_snapshot" :: held 1.332s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:00:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "cinder-quobyte-16bf09a1-2b53-4c74-9767-8b782040b03a" released by "delete_snapshot" :: held 1.358s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:00:58 devstack cinder-volume[83223]: DEBUG cinder.quota [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Created reservations ['38de3add-2089-4cce-8c34-3e956119ba64', '675df1a1-5818-4388-be93-9634de9712fc', 'f4340d9c-3413-46ed-8ce6-c205e976089c', 'a9a9f5a1-f926-42b8-ab68-a45bab611265'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:00:59 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Delete snapshot completed successfully. Sep 16 23:00:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-182d4455-812f-4309-8d46-f06c864d6e4c req-9dd99806-3a77-4ea6-b92e-0f15be1e5158 tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "cinder-db19eb0f-da8f-4876-b334-49d54c715543-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:00:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Acquiring lock "cinder-16bf09a1-2b53-4c74-9767-8b782040b03a-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "cinder-16bf09a1-2b53-4c74-9767-8b782040b03a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:59 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:00:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Acquiring lock "cinder-quobyte-16bf09a1-2b53-4c74-9767-8b782040b03a" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:00:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "cinder-quobyte-16bf09a1-2b53-4c74-9767-8b782040b03a" acquired by "delete_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:00:59 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a627a381-8bff-49d7-84d8-1eb499b9bde0]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:00:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a" returned: 0 in 0.382s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-16bf09a1-2b53-4c74-9767-8b782040b03a" returned: 0 in 0.109s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "cinder-quobyte-16bf09a1-2b53-4c74-9767-8b782040b03a" released by "delete_volume" :: held 0.645s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG cinder.quota [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Created reservations ['2f2b5212-1f72-4431-8f3b-826e9957169d', '8cf9e7ff-1004-42f6-94e5-e10650922979', '8a481822-8631-42dc-a29f-ccce676a20af', 'a87ca3b6-936f-4702-ad67-35215543d698'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.265s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:00 devstack cinder-volume[83223]: DEBUG cinder.manager [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:01:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Deleted volume successfully. Sep 16 23:01:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-3f30c018-7e49-47d7-bfd2-4048ad4c340b req-1b4885f2-6785-4135-917b-d3ce141f612b tempest-VolumesSnapshotsTestJSON-770884569 None] Lock "cinder-16bf09a1-2b53-4c74-9767-8b782040b03a-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:04 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Flow 'volume_create_manager' (b29a0c93-b789-4d1d-8166-5a0da09a6250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b8e224-eb58-43ea-93f9-cd1d36156d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b8e224-eb58-43ea-93f9-cd1d36156d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1961009771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941b0dde-48db-41c3-85a8-ba9d8109807f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='904014b502104eda80fa1c9301965d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:04Z,use_quota=True,user_id='a20f04f931164e8da1517cb2184182dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (807e33f0-a31a-4f6a-a25c-185bba2cd603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (807e33f0-a31a-4f6a-a25c-185bba2cd603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7faecd0-19d4-452b-b366-9776426d7297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7faecd0-19d4-452b-b366-9776426d7297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941b0dde-48db-41c3-85a8-ba9d8109807f', 'volume_name': 'volume-941b0dde-48db-41c3-85a8-ba9d8109807f', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004d8d9a-89e5-4279-8b1d-1b858eececa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004d8d9a-89e5-4279-8b1d-1b858eececa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107142fc-3ba0-40c3-b5cc-295faea3e44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:04 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Volume 941b0dde-48db-41c3-85a8-ba9d8109807f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941b0dde-48db-41c3-85a8-ba9d8109807f', 'volume_size': 1} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1961009771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941b0dde-48db-41c3-85a8-ba9d8109807f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='904014b502104eda80fa1c9301965d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:04Z,use_quota=True,user_id='a20f04f931164e8da1517cb2184182dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Creating volume 941b0dde-48db-41c3-85a8-ba9d8109807f {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:01:04 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-941b0dde-48db-41c3-85a8-ba9d8109807f 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:04 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=114, name=volume-941b0dde-48db-41c3-85a8-ba9d8109807f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-941b0dde-48db-41c3-85a8-ba9d8109807f 1073741824" returned: 0 in 0.297s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-941b0dde-48db-41c3-85a8-ba9d8109807f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-941b0dde-48db-41c3-85a8-ba9d8109807f" returned: 0 in 0.084s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] <== create_volume: return (443ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.455s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107142fc-3ba0-40c3-b5cc-295faea3e44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941b0dde-48db-41c3-85a8-ba9d8109807f', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396caa22-e8c6-4a9c-8db6-fbb816945c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:05 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Volume volume-941b0dde-48db-41c3-85a8-ba9d8109807f (941b0dde-48db-41c3-85a8-ba9d8109807f): created successfully Sep 16 23:01:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396caa22-e8c6-4a9c-8db6-fbb816945c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Flow 'volume_create_manager' (b29a0c93-b789-4d1d-8166-5a0da09a6250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:05 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8e654184-5436-49c6-834d-817956347dcc tempest-VolumesTestJSON-1942567584 None] Created volume successfully. Sep 16 23:01:06 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Flow 'volume_create_manager' (2e594ade-e86e-4c44-8c58-f3abc7508324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce4e341-27af-4cdc-9e7b-be5435239f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce4e341-27af-4cdc-9e7b-be5435239f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-399490545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed23ae48-bc7f-403c-a238-2078b51076bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='904014b502104eda80fa1c9301965d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:06Z,use_quota=True,user_id='a20f04f931164e8da1517cb2184182dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d293389b-725b-4fed-b4cb-bd5df97bd449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d293389b-725b-4fed-b4cb-bd5df97bd449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add45f20-a30d-4e22-9847-403ed91752f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add45f20-a30d-4e22-9847-403ed91752f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed23ae48-bc7f-403c-a238-2078b51076bd', 'volume_name': 'volume-ed23ae48-bc7f-403c-a238-2078b51076bd', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef4444a-3877-4a9f-a943-1e770088f94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef4444a-3877-4a9f-a943-1e770088f94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501882fb-0b4e-4cf3-827b-286afe9faf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:06 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Volume ed23ae48-bc7f-403c-a238-2078b51076bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed23ae48-bc7f-403c-a238-2078b51076bd', 'volume_size': 1} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-399490545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed23ae48-bc7f-403c-a238-2078b51076bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='904014b502104eda80fa1c9301965d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:06Z,use_quota=True,user_id='a20f04f931164e8da1517cb2184182dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Creating volume ed23ae48-bc7f-403c-a238-2078b51076bd {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:01:06 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:01:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ed23ae48-bc7f-403c-a238-2078b51076bd 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:06 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=115, name=volume-ed23ae48-bc7f-403c-a238-2078b51076bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:01:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ed23ae48-bc7f-403c-a238-2078b51076bd 1073741824" returned: 0 in 0.290s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ed23ae48-bc7f-403c-a238-2078b51076bd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ed23ae48-bc7f-403c-a238-2078b51076bd" returned: 0 in 0.083s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] <== create_volume: return (436ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:01:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.455s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501882fb-0b4e-4cf3-827b-286afe9faf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed23ae48-bc7f-403c-a238-2078b51076bd', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee5eb87-591a-4220-b98a-ff952f42ac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:07 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Volume volume-ed23ae48-bc7f-403c-a238-2078b51076bd (ed23ae48-bc7f-403c-a238-2078b51076bd): created successfully Sep 16 23:01:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee5eb87-591a-4220-b98a-ff952f42ac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Flow 'volume_create_manager' (2e594ade-e86e-4c44-8c58-f3abc7508324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:07 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-4531f066-6eec-4ae0-ba39-161ef3b2c058 tempest-VolumesTestJSON-1942567584 None] Created volume successfully. Sep 16 23:01:08 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Flow 'volume_create_manager' (771e1390-c5d8-4ba3-a29e-03641a35f8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4fe66c-5eb8-42d3-bd7b-afc43a954fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4fe66c-5eb8-42d3-bd7b-afc43a954fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1011694080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2da627-5da0-4255-8639-c4e37be2d6f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='904014b502104eda80fa1c9301965d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:08Z,use_quota=True,user_id='a20f04f931164e8da1517cb2184182dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f24d1a4-490d-4070-b216-23b506135673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f24d1a4-490d-4070-b216-23b506135673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd053a79-56ee-46ae-b78c-1b23d2b35867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd053a79-56ee-46ae-b78c-1b23d2b35867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2da627-5da0-4255-8639-c4e37be2d6f6', 'volume_name': 'volume-ea2da627-5da0-4255-8639-c4e37be2d6f6', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3fc685-89c9-485f-9d57-f7f7bb3becdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3fc685-89c9-485f-9d57-f7f7bb3becdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c20c4bb-1b1d-4707-9d72-759f06d2eec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:08 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Volume ea2da627-5da0-4255-8639-c4e37be2d6f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2da627-5da0-4255-8639-c4e37be2d6f6', 'volume_size': 1} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1011694080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2da627-5da0-4255-8639-c4e37be2d6f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='904014b502104eda80fa1c9301965d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:08Z,use_quota=True,user_id='a20f04f931164e8da1517cb2184182dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Creating volume ea2da627-5da0-4255-8639-c4e37be2d6f6 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:01:08 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ea2da627-5da0-4255-8639-c4e37be2d6f6 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:08 devstack quobyte-client[83246]: System call of process 97413 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:01:08 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=116, name=volume-ea2da627-5da0-4255-8639-c4e37be2d6f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ea2da627-5da0-4255-8639-c4e37be2d6f6 1073741824" returned: 0 in 0.305s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ea2da627-5da0-4255-8639-c4e37be2d6f6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ea2da627-5da0-4255-8639-c4e37be2d6f6" returned: 0 in 0.088s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] <== create_volume: return (461ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.474s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c20c4bb-1b1d-4707-9d72-759f06d2eec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2da627-5da0-4255-8639-c4e37be2d6f6', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf5ca33-35a4-4bfa-ab86-7aee4b7a3360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:08 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Volume volume-ea2da627-5da0-4255-8639-c4e37be2d6f6 (ea2da627-5da0-4255-8639-c4e37be2d6f6): created successfully Sep 16 23:01:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf5ca33-35a4-4bfa-ab86-7aee4b7a3360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:09 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Flow 'volume_create_manager' (771e1390-c5d8-4ba3-a29e-03641a35f8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:09 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-32404a0c-92a7-4673-93a2-4ce82fb93bc0 tempest-VolumesTestJSON-1942567584 None] Created volume successfully. Sep 16 23:01:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Acquiring lock "cinder-ea2da627-5da0-4255-8639-c4e37be2d6f6-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Lock "cinder-ea2da627-5da0-4255-8639-c4e37be2d6f6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Acquiring lock "cinder-quobyte-ea2da627-5da0-4255-8639-c4e37be2d6f6" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Lock "cinder-quobyte-ea2da627-5da0-4255-8639-c4e37be2d6f6" acquired by "delete_volume" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:11 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b79199-818c-4315-b2de-b4069dcc76cb]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ea2da627-5da0-4255-8639-c4e37be2d6f6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ea2da627-5da0-4255-8639-c4e37be2d6f6" returned: 0 in 0.389s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ea2da627-5da0-4255-8639-c4e37be2d6f6 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ea2da627-5da0-4255-8639-c4e37be2d6f6" returned: 0 in 0.116s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Lock "cinder-quobyte-ea2da627-5da0-4255-8639-c4e37be2d6f6" released by "delete_volume" :: held 0.653s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:12 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Created reservations ['00f561c7-91c8-4e19-a4fc-9f75797326ce', '2294cff6-73d8-4660-8bd6-cd3178c23f57', '53150325-0427-4b26-aa2f-fbc66541014a', 'c81178d0-2210-4c43-81a8-d2da3f740f60'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:01:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.103s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:12 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:01:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Deleted volume successfully. Sep 16 23:01:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1797625c-ebb4-4383-84c7-a6447d46b94a tempest-VolumesTestJSON-1942567584 None] Lock "cinder-ea2da627-5da0-4255-8639-c4e37be2d6f6-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Acquiring lock "cinder-ed23ae48-bc7f-403c-a238-2078b51076bd-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Lock "cinder-ed23ae48-bc7f-403c-a238-2078b51076bd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:13 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Acquiring lock "cinder-quobyte-ed23ae48-bc7f-403c-a238-2078b51076bd" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Lock "cinder-quobyte-ed23ae48-bc7f-403c-a238-2078b51076bd" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:13 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d193af-8b91-4ed6-ae6d-f3b551ccae35]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ed23ae48-bc7f-403c-a238-2078b51076bd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ed23ae48-bc7f-403c-a238-2078b51076bd" returned: 0 in 0.419s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ed23ae48-bc7f-403c-a238-2078b51076bd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-ed23ae48-bc7f-403c-a238-2078b51076bd" returned: 0 in 0.097s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Lock "cinder-quobyte-ed23ae48-bc7f-403c-a238-2078b51076bd" released by "delete_volume" :: held 0.685s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Created reservations ['cbad18c5-490a-4df4-9188-2166ef5a6d45', '975b11be-116c-4713-b326-8b6fd1358650', '66395690-70cf-4d6e-b9ea-cb8e5cf49fb4', '1d65dcf8-af58-43f3-a011-f5de972234ec'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.083s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:14 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:01:14 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Deleted volume successfully. Sep 16 23:01:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-addac482-cdff-4859-97de-2b84f53d02da tempest-VolumesTestJSON-1942567584 None] Lock "cinder-ed23ae48-bc7f-403c-a238-2078b51076bd-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Acquiring lock "cinder-941b0dde-48db-41c3-85a8-ba9d8109807f-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Lock "cinder-941b0dde-48db-41c3-85a8-ba9d8109807f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:15 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Acquiring lock "cinder-quobyte-941b0dde-48db-41c3-85a8-ba9d8109807f" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Lock "cinder-quobyte-941b0dde-48db-41c3-85a8-ba9d8109807f" acquired by "delete_volume" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:15 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e2c0af-69bd-42c8-8da1-ec1dbff46128]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-941b0dde-48db-41c3-85a8-ba9d8109807f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-941b0dde-48db-41c3-85a8-ba9d8109807f" returned: 0 in 0.381s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-941b0dde-48db-41c3-85a8-ba9d8109807f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-941b0dde-48db-41c3-85a8-ba9d8109807f" returned: 0 in 0.113s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Lock "cinder-quobyte-941b0dde-48db-41c3-85a8-ba9d8109807f" released by "delete_volume" :: held 0.627s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Created reservations ['c68a3027-e494-4c0d-a553-494533404fe8', '4c1325fe-bca5-44c5-8da4-a39a6b521910', 'c9a525cc-103b-46fa-ac80-0d2ce5240438', 'be558ab0-5653-4724-b7b4-6230d9aa9dc3'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.116s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:16 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:01:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Deleted volume successfully. Sep 16 23:01:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10dfb02c-281f-4541-9072-8886b245b586 tempest-VolumesTestJSON-1942567584 None] Lock "cinder-941b0dde-48db-41c3-85a8-ba9d8109807f-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:20 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5f05dd46-8c4f-4b4d-8435-2748bc5756ad tempest-BackendsCapabilitiesAdminTestsJSON-1041344187 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9134864807129, 'free_capacity_gb': 924.9134864807129, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83223) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 16 23:01:21 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c804b1d1-43b1-4221-a414-80ea04395ed4 tempest-BackendsCapabilitiesAdminTestsJSON-1041344187 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9134864807129, 'free_capacity_gb': 924.9134864807129, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83223) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 16 23:01:26 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a4991262-ce2a-419b-a4c0-87edd433d9e5 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:26 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a4991262-ce2a-419b-a4c0-87edd433d9e5 tempest-GroupSnapshotsTest-1199585373 None] Group tempest-GroupSnapshotsTest-Group-2130744463: creating Sep 16 23:01:26 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a4991262-ce2a-419b-a4c0-87edd433d9e5 tempest-GroupSnapshotsTest-1199585373 None] Group tempest-GroupSnapshotsTest-Group-2130744463: created successfully Sep 16 23:01:26 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a4991262-ce2a-419b-a4c0-87edd433d9e5 tempest-GroupSnapshotsTest-1199585373 None] Create group completed successfully. Sep 16 23:01:27 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Flow 'volume_create_manager' (7e1c6def-ea1f-43f5-94a9-9101be4e311a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebd32a6-a056-418b-bc08-3cea078883a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebd32a6-a056-418b-bc08-3cea078883a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-256432764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fea60a5c-b9a7-46b1-a145-fb27b78d310c,host='devstack@QuobyteHD#QuobyteHD',id=0b96bd99-d213-44d2-aadd-4b32c78bcdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cae1b180b7dd4b10b7f0ca0ddcf46f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:28Z,use_quota=True,user_id='7b5ece990577404eb0259ff820adfaa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32f15bed-0ae2-4c2b-b3fd-05dc233db8e4),volume_type_id=32f15bed-0ae2-4c2b-b3fd-05dc233db8e4)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d02f2a-7eb8-4698-bd86-d22e39bb2c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d02f2a-7eb8-4698-bd86-d22e39bb2c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7d2663-d179-4ca6-a81a-e3e4375d7cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7d2663-d179-4ca6-a81a-e3e4375d7cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b96bd99-d213-44d2-aadd-4b32c78bcdfc', 'volume_name': 'volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fae4261-716b-4b9e-b939-c1876a891f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fae4261-716b-4b9e-b939-c1876a891f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8931ae-fd29-4462-ad57-9a6daa527c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:27 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Volume 0b96bd99-d213-44d2-aadd-4b32c78bcdfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc', 'volume_size': 1} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fea60a5c-b9a7-46b1-a145-fb27b78d310c,created_at=2025-09-16T21:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-256432764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fea60a5c-b9a7-46b1-a145-fb27b78d310c,host='devstack@QuobyteHD#QuobyteHD',id=0b96bd99-d213-44d2-aadd-4b32c78bcdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cae1b180b7dd4b10b7f0ca0ddcf46f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:28Z,use_quota=True,user_id='7b5ece990577404eb0259ff820adfaa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32f15bed-0ae2-4c2b-b3fd-05dc233db8e4),volume_type_id=32f15bed-0ae2-4c2b-b3fd-05dc233db8e4)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Creating volume 0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:01:27 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:01:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:28 devstack quobyte-client[83246]: System call of process 97438 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:01:28 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=117, name=volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc 1073741824" returned: 0 in 0.305s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" returned: 0 in 0.083s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] <== create_volume: return (451ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.463s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8931ae-fd29-4462-ad57-9a6daa527c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4156120-0d1e-495b-9846-ea395e4f5ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.322s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:01:28 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Volume volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc (0b96bd99-d213-44d2-aadd-4b32c78bcdfc): created successfully Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4156120-0d1e-495b-9846-ea395e4f5ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:28 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Flow 'volume_create_manager' (7e1c6def-ea1f-43f5-94a9-9101be4e311a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:28 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-835d6256-e5ed-461c-9d94-7b1fa62029cc tempest-GroupSnapshotsTest-1199585373 None] Created volume successfully. Sep 16 23:01:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] GroupSnapshot 46b8bd60-d888-4623-b728-6820c139e664: creating. Sep 16 23:01:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:30 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Group snapshot 46b8bd60-d888-4623-b728-6820c139e664: creating. {{(pid=83223) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 23:01:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:30 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Creating offline snapshot 4c86f345-7434-493c-9d22-dd8e90ae79a9 of volume 0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 23:01:30 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[35736f1d-00e5-46b2-8698-5a52ed1ed1f9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" returned: 0 in 0.390s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:30 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=118, name=volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 1G" returned: 0 in 0.214s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img rebase -u -b volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9" returned: 0 in 0.119s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9" returned: 0 in 0.270s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.info" returned: 0 in 0.115s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.info" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.556s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:32 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-50884107-415d-41b1-96ad-3650f7be9440 tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 46b8bd60-d888-4623-b728-6820c139e664: created successfully Sep 16 23:01:33 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-4c86f345-7434-493c-9d22-dd8e90ae79a9-e949d340-19b4-4bae-8ca6-8263deb5429f" by "_create_volume_from_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-4c86f345-7434-493c-9d22-dd8e90ae79a9-e949d340-19b4-4bae-8ca6-8263deb5429f" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Creating volume e949d340-19b4-4bae-8ca6-8263deb5429f from snapshot 4c86f345-7434-493c-9d22-dd8e90ae79a9 {{(pid=83223) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-e949d340-19b4-4bae-8ca6-8263deb5429f" by "_copy_volume_from_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-e949d340-19b4-4bae-8ca6-8263deb5429f" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] snapshot: 4c86f345-7434-493c-9d22-dd8e90ae79a9, volume: e949d340-19b4-4bae-8ca6-8263deb5429f, {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dedb9c-57f5-4f08-8308-30121cce88cc]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9" returned: 0 in 0.363s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Creating direct copy from snapshot {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[6921050c-12f0-4123-93a0-0fd95a386bec]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" returned: 0 in 0.383s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG cinder.utils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f not found in is_blk_device check {{(pid=83223) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 23:01:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:35 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=120, name=volume-e949d340-19b4-4bae-8ca6-8263deb5429f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f" returned: 0 in 4.366s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7c731c-59f5-4fa1-a865-c4aa54f17e84]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" returned: 0 in 0.500s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 23:01:39 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Converted 1024.00 MB image at 233.47 MB/s Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f" returned: 0 in 0.077s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-e949d340-19b4-4bae-8ca6-8263deb5429f" released by "_copy_volume_from_snapshot" :: held 6.007s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-4c86f345-7434-493c-9d22-dd8e90ae79a9-e949d340-19b4-4bae-8ca6-8263deb5429f" released by "_create_volume_from_snapshot" :: held 6.038s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.102s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:40 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=56,cinder:UPDATE=70,cinder:INSERT=15,cinder:DELETE=6 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:01:40 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=55,cinder:INSERT=17,cinder:UPDATE=83,cinder:DELETE=7 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:01:40 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-eb2d9f18-981f-463b-935b-7163b6259591 tempest-GroupSnapshotsTest-1199585373 None] Create group from source-snapshot-46b8bd60-d888-4623-b728-6820c139e664 completed successfully. Sep 16 23:01:41 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-e949d340-19b4-4bae-8ca6-8263deb5429f" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:41 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-e949d340-19b4-4bae-8ca6-8263deb5429f" acquired by "delete_volume" :: waited 0.019s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:41 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1384d5e-1b0f-49a6-9010-b4e5572558a6]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f" returned: 0 in 0.358s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e949d340-19b4-4bae-8ca6-8263deb5429f" returned: 0 in 0.083s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-e949d340-19b4-4bae-8ca6-8263deb5429f" released by "delete_volume" :: held 0.591s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['34712e14-ff2f-4876-a922-5b81bc48dc8d'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:01:42 devstack cinder-volume[83223]: WARNING cinder.quota [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2092137942 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2092137942, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:01:42 devstack cinder-volume[83223]: WARNING cinder.quota [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2092137942 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2092137942, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['1b31d888-432f-43c3-b242-be7fb44ea623', 'f51db36f-8d72-4e18-a27e-2a0a0e6ecc8d', 'ce0a5454-5595-47bb-aac2-30232a54f9f9', '70c52366-b8fc-4151-a532-83735b793b48'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.108s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:42 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:01:42 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-9c15e564-113d-43ed-aa5d-5bf590f633cb tempest-GroupSnapshotsTest-1199585373 None] Delete group completed successfully. Sep 16 23:01:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 46b8bd60-d888-4623-b728-6820c139e664: deleting Sep 16 23:01:44 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 46b8bd60-d888-4623-b728-6820c139e664: deleting {{(pid=83223) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" acquired by "delete_snapshot" :: waited 0.062s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-4c86f345-7434-493c-9d22-dd8e90ae79a9" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-4c86f345-7434-493c-9d22-dd8e90ae79a9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Deleting offline snapshot 4c86f345-7434-493c-9d22-dd8e90ae79a9 of volume 0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] snapshot_file for this snap is: volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e42e88-9c4e-4547-ac87-b0c8f1acb041]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9" returned: 0 in 0.360s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f6cfba-ed1b-4818-8d9e-8053c7dd0a76]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" returned: 0 in 0.399s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9" returned: 0 in 0.185s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc.4c86f345-7434-493c-9d22-dd8e90ae79a9" returned: 0 in 0.081s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:45 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-4c86f345-7434-493c-9d22-dd8e90ae79a9" released by "_delete_snapshot" :: held 1.327s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:45 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" released by "delete_snapshot" :: held 1.362s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:45 devstack cinder-volume[83223]: WARNING cinder.quota [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2092137942 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2092137942, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:01:45 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['589f0221-d99f-402f-81e2-4f10aed90856', 'd73e567d-495a-48b3-9926-ec5ca9bf9b63', '2a49963f-f746-4f36-bac9-a075e41ce01a', '3b12a88a-5123-408e-af96-363a0e82a887'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:01:46 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a9294dee-2ae4-4a05-86a5-39946c07d776 tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 46b8bd60-d888-4623-b728-6820c139e664: deleted successfully Sep 16 23:01:46 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:01:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" acquired by "delete_volume" :: waited 0.020s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:01:46 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13119cc-6bb7-4699-9ea2-3d1c4e893c27]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" returned: 0 in 0.381s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" returned: 0 in 0.122s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-0b96bd99-d213-44d2-aadd-4b32c78bcdfc" released by "delete_volume" :: held 0.650s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['ba38dfb9-7475-4f7a-a331-d38e9d2d69da'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:01:47 devstack cinder-volume[83223]: WARNING cinder.db.sqlalchemy.api [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2092137942'] Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['4b2dccfc-a87d-4644-9e57-493bb3ed58ab', 'c96ff2f4-4382-4cf3-b546-b9853b76b084', 'b14fecec-136e-47ee-b3a1-59d77ebbb730', 'f3978a94-a66b-4a36-ac1d-4f081d44cdc6'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:47 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:01:47 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0846c846-5b90-4426-a445-5f8609570d60 tempest-GroupSnapshotsTest-1199585373 None] Delete group completed successfully. Sep 16 23:01:49 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-722b4bfa-3b3a-49de-adb8-8be9793e9ce9 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:49 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-722b4bfa-3b3a-49de-adb8-8be9793e9ce9 tempest-GroupSnapshotsTest-1199585373 None] Group tempest-GroupSnapshotsTest-Group-968376036: creating Sep 16 23:01:49 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-722b4bfa-3b3a-49de-adb8-8be9793e9ce9 tempest-GroupSnapshotsTest-1199585373 None] Group tempest-GroupSnapshotsTest-Group-968376036: created successfully Sep 16 23:01:49 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-722b4bfa-3b3a-49de-adb8-8be9793e9ce9 tempest-GroupSnapshotsTest-1199585373 None] Create group completed successfully. Sep 16 23:01:50 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Flow 'volume_create_manager' (ba4253af-8bd1-4d4a-8d3a-439f9142fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e61fd4-9ed5-4ac8-b058-3ef9747edb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e61fd4-9ed5-4ac8-b058-3ef9747edb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750800548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c97010d-be33-4af6-809f-63f5044024e4,host='devstack@QuobyteHD#QuobyteHD',id=a3209b26-207c-487e-8f1c-c5f00abef201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cae1b180b7dd4b10b7f0ca0ddcf46f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:51Z,use_quota=True,user_id='7b5ece990577404eb0259ff820adfaa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d1ccece-59d0-4a04-989e-35a74346d00d),volume_type_id=9d1ccece-59d0-4a04-989e-35a74346d00d)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc31efa-1600-4112-aefc-30ba01ccb4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc31efa-1600-4112-aefc-30ba01ccb4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbb465c-ae31-4ec9-a7e2-9a218732a9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbb465c-ae31-4ec9-a7e2-9a218732a9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3209b26-207c-487e-8f1c-c5f00abef201', 'volume_name': 'volume-a3209b26-207c-487e-8f1c-c5f00abef201', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbca00a-9fa6-4697-ab9e-2e8b3e63e97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbca00a-9fa6-4697-ab9e-2e8b3e63e97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d12bb9-8c9b-461a-86cf-f19110108a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:50 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Volume a3209b26-207c-487e-8f1c-c5f00abef201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3209b26-207c-487e-8f1c-c5f00abef201', 'volume_size': 1} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c97010d-be33-4af6-809f-63f5044024e4,created_at=2025-09-16T21:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750800548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c97010d-be33-4af6-809f-63f5044024e4,host='devstack@QuobyteHD#QuobyteHD',id=a3209b26-207c-487e-8f1c-c5f00abef201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cae1b180b7dd4b10b7f0ca0ddcf46f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:51Z,use_quota=True,user_id='7b5ece990577404eb0259ff820adfaa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d1ccece-59d0-4a04-989e-35a74346d00d),volume_type_id=9d1ccece-59d0-4a04-989e-35a74346d00d)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Creating volume a3209b26-207c-487e-8f1c-c5f00abef201 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:01:50 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:01:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:51 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=121, name=volume-a3209b26-207c-487e-8f1c-c5f00abef201, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:01:51 devstack quobyte-client[83246]: System call of process 97508 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:01:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201 1073741824" returned: 0 in 0.300s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201" returned: 0 in 0.080s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:51 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] <== create_volume: return (444ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:01:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.456s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d12bb9-8c9b-461a-86cf-f19110108a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3209b26-207c-487e-8f1c-c5f00abef201', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e378fdb1-9e53-4e3a-a016-09a3beff4f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:51 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Volume volume-a3209b26-207c-487e-8f1c-c5f00abef201 (a3209b26-207c-487e-8f1c-c5f00abef201): created successfully Sep 16 23:01:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e378fdb1-9e53-4e3a-a016-09a3beff4f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Flow 'volume_create_manager' (ba4253af-8bd1-4d4a-8d3a-439f9142fccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:51 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-55512e09-1765-4f79-a5b5-df4fae67dba0 tempest-GroupSnapshotsTest-1199585373 None] Created volume successfully. Sep 16 23:01:52 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Flow 'volume_create_manager' (0443427b-2da8-420c-b9a8-c4928c8055c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df2da4b-e283-4667-9187-8759873be602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df2da4b-e283-4667-9187-8759873be602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1352119183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c97010d-be33-4af6-809f-63f5044024e4,host='devstack@QuobyteHD#QuobyteHD',id=9ba1d824-0acc-4c71-bd29-1beeb4b2777b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cae1b180b7dd4b10b7f0ca0ddcf46f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:52Z,use_quota=True,user_id='7b5ece990577404eb0259ff820adfaa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d1ccece-59d0-4a04-989e-35a74346d00d),volume_type_id=9d1ccece-59d0-4a04-989e-35a74346d00d)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4592acef-dec7-4d44-b833-5d17d8b53c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4592acef-dec7-4d44-b833-5d17d8b53c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730eaf04-8f46-4e87-a0b9-36ac5cb23e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730eaf04-8f46-4e87-a0b9-36ac5cb23e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba1d824-0acc-4c71-bd29-1beeb4b2777b', 'volume_name': 'volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3037c80-1d1c-45d8-a76f-affe44c7d4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3037c80-1d1c-45d8-a76f-affe44c7d4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f177c1-37b6-480e-a38f-a31c6b07b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:52 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Volume 9ba1d824-0acc-4c71-bd29-1beeb4b2777b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b', 'volume_size': 1} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c97010d-be33-4af6-809f-63f5044024e4,created_at=2025-09-16T21:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1352119183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c97010d-be33-4af6-809f-63f5044024e4,host='devstack@QuobyteHD#QuobyteHD',id=9ba1d824-0acc-4c71-bd29-1beeb4b2777b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cae1b180b7dd4b10b7f0ca0ddcf46f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:01:52Z,use_quota=True,user_id='7b5ece990577404eb0259ff820adfaa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d1ccece-59d0-4a04-989e-35a74346d00d),volume_type_id=9d1ccece-59d0-4a04-989e-35a74346d00d)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Creating volume 9ba1d824-0acc-4c71-bd29-1beeb4b2777b {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:01:52 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:52 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=122, name=volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b 1073741824" returned: 0 in 0.301s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" returned: 0 in 0.091s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] <== create_volume: return (461ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:01:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.475s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f177c1-37b6-480e-a38f-a31c6b07b410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81854975-dfb3-4c20-9d6b-faae59f24f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:01:53 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Volume volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b (9ba1d824-0acc-4c71-bd29-1beeb4b2777b): created successfully Sep 16 23:01:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81854975-dfb3-4c20-9d6b-faae59f24f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:01:53 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Flow 'volume_create_manager' (0443427b-2da8-420c-b9a8-c4928c8055c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:01:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e48b20b1-2200-4351-851a-5c543b2cf860 tempest-GroupSnapshotsTest-1199585373 None] Created volume successfully. Sep 16 23:01:53 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7e5dddca-8b34-439d-9d21-b0239d3a4cde tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7e5dddca-8b34-439d-9d21-b0239d3a4cde tempest-GroupSnapshotsTest-1199585373 None] Update group completed successfully. Sep 16 23:01:54 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c55af387-19fb-46e5-b39f-4ccc8f794b16 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:54 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c55af387-19fb-46e5-b39f-4ccc8f794b16 tempest-GroupSnapshotsTest-1199585373 None] Update group completed successfully. Sep 16 23:01:55 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-80ca1fab-d8dd-48c3-9d15-1fe7b27ca0af tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:55 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-80ca1fab-d8dd-48c3-9d15-1fe7b27ca0af tempest-GroupSnapshotsTest-1199585373 None] Update group completed successfully. Sep 16 23:01:56 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-887b349c-2340-4ddc-9fba-abb4fe887bf1 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:56 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-887b349c-2340-4ddc-9fba-abb4fe887bf1 tempest-GroupSnapshotsTest-1199585373 None] Update group completed successfully. Sep 16 23:01:58 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] GroupSnapshot 37cfe41a-7293-45e8-a59b-d241bcdc4cb6: creating. Sep 16 23:01:58 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:01:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Group snapshot 37cfe41a-7293-45e8-a59b-d241bcdc4cb6: creating. {{(pid=83223) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 23:01:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Creating offline snapshot 6ad9ece3-3284-40c3-a553-672807efed42 of volume a3209b26-207c-487e-8f1c-c5f00abef201 {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 23:01:58 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69522a6-7106-4d8e-9958-735a50b6a1ce]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201" returned: 0 in 0.390s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:58 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=123, name=volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:01:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42 1G" returned: 0 in 0.211s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a3209b26-207c-487e-8f1c-c5f00abef201 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img rebase -u -b volume-a3209b26-207c-487e-8f1c-c5f00abef201 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42" returned: 0 in 0.120s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.info" returned: 0 in 0.095s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.info" returned: 0 in 0.080s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.346s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Creating offline snapshot d8934019-94b8-413b-9b5e-c658d599db62 of volume 9ba1d824-0acc-4c71-bd29-1beeb4b2777b {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf6e07f-768f-42fd-a736-1c2fc7260449]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:01:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" returned: 0 in 0.369s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:00 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=125, name=volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62 1G" returned: 0 in 0.215s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img rebase -u -b volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62" returned: 0 in 0.128s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62" returned: 0 in 0.080s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.info" returned: 0 in 0.083s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:02:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.info" returned: 0 in 0.079s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.531s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:02:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a7659127-b666-449d-9b26-f0c8a8a2360b tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 37cfe41a-7293-45e8-a59b-d241bcdc4cb6: created successfully Sep 16 23:02:02 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 37cfe41a-7293-45e8-a59b-d241bcdc4cb6: deleting Sep 16 23:02:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:02:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 37cfe41a-7293-45e8-a59b-d241bcdc4cb6: deleting {{(pid=83223) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 23:02:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-a3209b26-207c-487e-8f1c-c5f00abef201" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-a3209b26-207c-487e-8f1c-c5f00abef201" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-6ad9ece3-3284-40c3-a553-672807efed42" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-6ad9ece3-3284-40c3-a553-672807efed42" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Deleting offline snapshot 6ad9ece3-3284-40c3-a553-672807efed42 of volume a3209b26-207c-487e-8f1c-c5f00abef201 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 23:02:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] snapshot_file for this snap is: volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 23:02:02 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[07435376-920d-4811-a225-8ba714556723]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42" returned: 0 in 0.367s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3209b26-207c-487e-8f1c-c5f00abef201(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 23:02:03 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[44494f3e-e7ad-448a-9e8a-776a6d2b1dc3]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201" returned: 0 in 0.387s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42" returned: 0 in 0.205s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201.6ad9ece3-3284-40c3-a553-672807efed42" returned: 0 in 0.081s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-6ad9ece3-3284-40c3-a553-672807efed42" released by "_delete_snapshot" :: held 1.320s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-a3209b26-207c-487e-8f1c-c5f00abef201" released by "delete_snapshot" :: held 1.340s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-d8934019-94b8-413b-9b5e-c658d599db62" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-d8934019-94b8-413b-9b5e-c658d599db62" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Deleting offline snapshot d8934019-94b8-413b-9b5e-c658d599db62 of volume 9ba1d824-0acc-4c71-bd29-1beeb4b2777b {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] snapshot_file for this snap is: volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae90974-5595-44c7-8305-74f8772ba14b]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62" returned: 0 in 0.347s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0460dd90-6290-4ed6-9086-5dd288406d5e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" returned: 0 in 0.380s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:05 devstack quobyte-client[83246]: System call of process 97592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:02:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62" returned: 0 in 0.171s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b.d8934019-94b8-413b-9b5e-c658d599db62" returned: 0 in 0.077s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:05 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-d8934019-94b8-413b-9b5e-c658d599db62" released by "_delete_snapshot" :: held 1.268s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:05 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" released by "delete_snapshot" :: held 1.287s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:05 devstack cinder-volume[83223]: WARNING cinder.quota [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1959484486 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1959484486, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:02:05 devstack cinder-volume[83223]: WARNING cinder.quota [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1959484486 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1959484486, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:02:05 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['9e5b6723-8f87-408d-8772-dcfad4a79416', '4a12fc7f-84ab-4527-a50f-7557210afd67', '23a77c46-0147-47aa-8cd1-20ff1ae62ecf', 'd578f67c-ec40-45a4-b799-bdebe75969a9'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:02:06 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['01f61db8-27d6-4aaa-a65a-84fc826cbfb7', 'ca5db64b-a742-4e27-a328-5a6786d33906', 'b95dc9dd-c311-4836-a1f4-cabe2d72a38e', '836b053b-65d5-4ec8-af67-8dc815b85e08'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:02:06 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6c3c8747-2947-4505-9885-f3aad9ab19f0 tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 37cfe41a-7293-45e8-a59b-d241bcdc4cb6: deleted successfully Sep 16 23:02:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:02:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:07 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" acquired by "delete_volume" :: waited 0.016s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:07 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a001073e-8214-41a7-afb7-d7a2429d5b95]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" returned: 0 in 0.374s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-9ba1d824-0acc-4c71-bd29-1beeb4b2777b" released by "delete_volume" :: held 0.639s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-a3209b26-207c-487e-8f1c-c5f00abef201" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-a3209b26-207c-487e-8f1c-c5f00abef201" acquired by "delete_volume" :: waited 0.021s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:08 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5548e6ab-4262-4eb3-a407-88b27c434f01]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201" returned: 0 in 0.368s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a3209b26-207c-487e-8f1c-c5f00abef201" returned: 0 in 0.081s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-a3209b26-207c-487e-8f1c-c5f00abef201" released by "delete_volume" :: held 0.657s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['c013480c-baa7-4f98-bef2-4844c39b4aae'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:02:09 devstack cinder-volume[83223]: WARNING cinder.quota [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1959484486 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1959484486, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['acf40190-6f65-4d91-99bb-d7384cf8cbec', 'd8199539-b478-45d9-bceb-edcf3e170711', '2618fcff-3f0f-4b3e-97a8-25d04ec8c2a4', 'f7902279-d976-45ff-98e6-7cd3a2735934'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['defb1cb2-418d-4921-8b38-c936b63c35c0', 'ef5eeadf-b3a5-4de8-af5c-a3607a98015c', 'b5eb963e-40ee-4ce4-9015-157cb13e6a07', 'b3ead757-7a24-4a24-b0b4-68790c2e5664'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.082s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:09 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:02:09 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-42439a0c-4d1b-4c67-a9c5-07601ac4e84e tempest-GroupSnapshotsTest-1199585373 None] Delete group completed successfully. Sep 16 23:02:10 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-5f95ea8a-5916-4601-a701-a80764a0e9dd tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:02:10 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5f95ea8a-5916-4601-a701-a80764a0e9dd tempest-GroupSnapshotsTest-1199585373 None] Group tempest-GroupSnapshotsTest-Group-1920776137: creating Sep 16 23:02:10 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5f95ea8a-5916-4601-a701-a80764a0e9dd tempest-GroupSnapshotsTest-1199585373 None] Group tempest-GroupSnapshotsTest-Group-1920776137: created successfully Sep 16 23:02:10 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5f95ea8a-5916-4601-a701-a80764a0e9dd tempest-GroupSnapshotsTest-1199585373 None] Create group completed successfully. Sep 16 23:02:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Flow 'volume_create_manager' (7029dc6c-9297-413c-a536-37425ca8deea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bfb8ea6-51eb-4370-b46f-71255f429b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bfb8ea6-51eb-4370-b46f-71255f429b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-559038199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d26e15e-31d6-4027-b7d8-aa0ef0a94714,host='devstack@QuobyteHD#QuobyteHD',id=55c3ea6c-382a-4744-bdcf-93d889c8019e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cae1b180b7dd4b10b7f0ca0ddcf46f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:02:11Z,use_quota=True,user_id='7b5ece990577404eb0259ff820adfaa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3ae702-3ef5-4e43-91d0-b3302e32ea51),volume_type_id=6d3ae702-3ef5-4e43-91d0-b3302e32ea51)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b308aaa-455c-4e61-9c12-220cf1bb74a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b308aaa-455c-4e61-9c12-220cf1bb74a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23621602-b104-46ac-95e8-cc95ba82aa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23621602-b104-46ac-95e8-cc95ba82aa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55c3ea6c-382a-4744-bdcf-93d889c8019e', 'volume_name': 'volume-55c3ea6c-382a-4744-bdcf-93d889c8019e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b793971-30ee-4bc6-a554-2a4060c4dd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b793971-30ee-4bc6-a554-2a4060c4dd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81064fb-9676-4daa-af40-1e4c26bf00e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:11 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Volume 55c3ea6c-382a-4744-bdcf-93d889c8019e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55c3ea6c-382a-4744-bdcf-93d889c8019e', 'volume_size': 1} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3d26e15e-31d6-4027-b7d8-aa0ef0a94714,created_at=2025-09-16T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-559038199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d26e15e-31d6-4027-b7d8-aa0ef0a94714,host='devstack@QuobyteHD#QuobyteHD',id=55c3ea6c-382a-4744-bdcf-93d889c8019e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cae1b180b7dd4b10b7f0ca0ddcf46f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:02:11Z,use_quota=True,user_id='7b5ece990577404eb0259ff820adfaa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d3ae702-3ef5-4e43-91d0-b3302e32ea51),volume_type_id=6d3ae702-3ef5-4e43-91d0-b3302e32ea51)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Creating volume 55c3ea6c-382a-4744-bdcf-93d889c8019e {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:02:11 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:11 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=127, name=volume-55c3ea6c-382a-4744-bdcf-93d889c8019e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e 1073741824" returned: 0 in 0.300s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e" returned: 0 in 0.082s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] <== create_volume: return (446ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.461s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81064fb-9676-4daa-af40-1e4c26bf00e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55c3ea6c-382a-4744-bdcf-93d889c8019e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc86485-e857-43e9-b583-806f9c19d939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:12 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Volume volume-55c3ea6c-382a-4744-bdcf-93d889c8019e (55c3ea6c-382a-4744-bdcf-93d889c8019e): created successfully Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc86485-e857-43e9-b583-806f9c19d939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Flow 'volume_create_manager' (7029dc6c-9297-413c-a536-37425ca8deea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:02:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d7313c90-af10-40a6-805c-1a13ea597ee5 tempest-GroupSnapshotsTest-1199585373 None] Created volume successfully. Sep 16 23:02:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] GroupSnapshot 8fb64c67-e464-49fa-971f-3cd4b2c6f36a: creating. Sep 16 23:02:12 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Group snapshot 8fb64c67-e464-49fa-971f-3cd4b2c6f36a: creating. {{(pid=83223) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Creating offline snapshot a4e845a0-2964-4a2e-bce2-552b2945cfa8 of volume 55c3ea6c-382a-4744-bdcf-93d889c8019e {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcc1674-064c-4856-a563-38ba6b660e49]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e" returned: 0 in 0.394s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:13 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=128, name=volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:02:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8 1G" returned: 0 in 0.211s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img rebase -u -b volume-55c3ea6c-382a-4744-bdcf-93d889c8019e -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img rebase -u -b volume-55c3ea6c-382a-4744-bdcf-93d889c8019e -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8" returned: 0 in 0.120s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:02:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8" returned: 0 in 0.092s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 23:02:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8" returned: 0 in 0.098s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.info" returned: 0 in 0.132s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:02:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.info" returned: 0 in 0.087s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.441s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:02:14 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-bf36a5be-4088-4456-b8ee-981c76efa3ee tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 8fb64c67-e464-49fa-971f-3cd4b2c6f36a: created successfully Sep 16 23:02:15 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 8fb64c67-e464-49fa-971f-3cd4b2c6f36a: deleting Sep 16 23:02:15 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 8fb64c67-e464-49fa-971f-3cd4b2c6f36a: deleting {{(pid=83223) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-55c3ea6c-382a-4744-bdcf-93d889c8019e" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-55c3ea6c-382a-4744-bdcf-93d889c8019e" acquired by "delete_snapshot" :: waited 0.097s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-a4e845a0-2964-4a2e-bce2-552b2945cfa8" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-a4e845a0-2964-4a2e-bce2-552b2945cfa8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Deleting offline snapshot a4e845a0-2964-4a2e-bce2-552b2945cfa8 of volume 55c3ea6c-382a-4744-bdcf-93d889c8019e {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] snapshot_file for this snap is: volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d943552c-d1c1-4348-b2d3-1f70035d6fdc]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8" returned: 0 in 0.400s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55c3ea6c-382a-4744-bdcf-93d889c8019e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9d4602-7563-4d3d-a477-c08974050e0a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e" returned: 0 in 0.360s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8" returned: 0 in 0.248s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e.a4e845a0-2964-4a2e-bce2-552b2945cfa8" returned: 0 in 0.096s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-a4e845a0-2964-4a2e-bce2-552b2945cfa8" released by "_delete_snapshot" :: held 1.417s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-55c3ea6c-382a-4744-bdcf-93d889c8019e" released by "delete_snapshot" :: held 1.440s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:17 devstack cinder-volume[83223]: WARNING cinder.quota [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-85007102 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-85007102, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:02:17 devstack cinder-volume[83223]: WARNING cinder.quota [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-85007102 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-85007102, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:02:17 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['efe35773-8d74-4b10-ba9b-af1363afb90d', 'c2dd97ab-f33e-4d57-95b6-a9d7ebb5f680', 'fe918cf3-fde4-402d-8081-50d35eb5f160', '5d8c1482-888f-402d-be98-e2a820553bb0'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:02:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7ac36b76-e7d5-47b3-bb96-d31a11ca1baf tempest-GroupSnapshotsTest-1199585373 None] group_snapshot 8fb64c67-e464-49fa-971f-3cd4b2c6f36a: deleted successfully Sep 16 23:02:17 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:02:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "cinder-quobyte-55c3ea6c-382a-4744-bdcf-93d889c8019e" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-55c3ea6c-382a-4744-bdcf-93d889c8019e" acquired by "delete_volume" :: waited 0.019s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:17 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3a2243-1542-4fe0-9fd0-7608e181b50a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e" returned: 0 in 0.401s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-55c3ea6c-382a-4744-bdcf-93d889c8019e" returned: 0 in 0.116s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Lock "cinder-quobyte-55c3ea6c-382a-4744-bdcf-93d889c8019e" released by "delete_volume" :: held 0.686s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:18 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['a8714837-469d-411f-8b23-76c064d4af04'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:02:18 devstack cinder-volume[83223]: WARNING cinder.quota [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-85007102 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-85007102, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:02:18 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Created reservations ['3954cd69-c8ec-4bd7-b668-5fe1f2291e76', 'cbc8f95b-969f-4e8f-bf1e-1e571d3786bb', 'dd72e511-0cc8-482a-a369-50fc743267bb', '8b9c1935-98dc-45c1-83b5-ac23713de4c6'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:02:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:02:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:02:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:02:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:02:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:02:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.093s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:19 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:02:19 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-de2bb18d-825d-4b77-abc9-ec9119859634 tempest-GroupSnapshotsTest-1199585373 None] Delete group completed successfully. Sep 16 23:02:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:02:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:02:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:02:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:02:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:02:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:02:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.094s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:02:29 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=96,cinder:UPDATE=84,cinder:INSERT=22,cinder:DELETE=2 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:02:29 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=93,cinder:UPDATE=99,cinder:INSERT=18,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:02:34 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Flow 'volume_create_manager' (f63dec16-a379-45cd-ac11-fff34f209cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a1b3f2-c487-43fa-9738-d90a28bf4e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a1b3f2-c487-43fa-9738-d90a28bf4e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-792685328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35cd7e06-9ac1-4a03-a014-bb7909f0006a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d7a6d593824b28af860c09fa93bf62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:02:34Z,use_quota=True,user_id='577c73a7e69747beb97d23e24cd082cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233b4cb4-8cf3-4b9d-abe7-afcf7653b6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233b4cb4-8cf3-4b9d-abe7-afcf7653b6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e0f300-0780-416c-ab03-f42761c42e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e0f300-0780-416c-ab03-f42761c42e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35cd7e06-9ac1-4a03-a014-bb7909f0006a', 'volume_name': 'volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef50f4b-d5bb-4078-872a-853270637884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef50f4b-d5bb-4078-872a-853270637884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a4474b-8794-43d9-a81f-0a709d3640bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:34 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Volume 35cd7e06-9ac1-4a03-a014-bb7909f0006a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a', 'volume_size': 1} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-792685328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35cd7e06-9ac1-4a03-a014-bb7909f0006a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d7a6d593824b28af860c09fa93bf62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:02:34Z,use_quota=True,user_id='577c73a7e69747beb97d23e24cd082cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Creating volume 35cd7e06-9ac1-4a03-a014-bb7909f0006a {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:02:34 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:34 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=130, name=volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a 1073741824" returned: 0 in 0.298s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a" returned: 0 in 0.082s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] <== create_volume: return (453ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.467s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a4474b-8794-43d9-a81f-0a709d3640bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0dbad9-7dae-437c-8abd-10911ebbd82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:02:34 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Volume volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a (35cd7e06-9ac1-4a03-a014-bb7909f0006a): created successfully Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0dbad9-7dae-437c-8abd-10911ebbd82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:02:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Flow 'volume_create_manager' (f63dec16-a379-45cd-ac11-fff34f209cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:02:34 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-57e07400-1a58-4ae6-b9ff-5caaeb6e64ae tempest-VolumeQuotasNegativeTestJSON-262262838 None] Created volume successfully. Sep 16 23:02:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Acquiring lock "cinder-35cd7e06-9ac1-4a03-a014-bb7909f0006a-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Lock "cinder-35cd7e06-9ac1-4a03-a014-bb7909f0006a-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:37 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:02:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Acquiring lock "cinder-quobyte-35cd7e06-9ac1-4a03-a014-bb7909f0006a" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:02:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Lock "cinder-quobyte-35cd7e06-9ac1-4a03-a014-bb7909f0006a" acquired by "delete_volume" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:02:37 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f3f21e-dce4-4cc3-a5f8-b8bf37e05689]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:02:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a" returned: 0 in 0.368s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-35cd7e06-9ac1-4a03-a014-bb7909f0006a" returned: 0 in 0.105s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Lock "cinder-quobyte-35cd7e06-9ac1-4a03-a014-bb7909f0006a" released by "delete_volume" :: held 0.617s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:38 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Created reservations ['6b15acb8-3625-4e70-9ffc-99f14d6aca9f', '3631e43f-e79c-4d50-add6-19037a4dca18', 'f27b6766-3ab8-4d93-83d9-08b9d4b3c00a', 'd37e5903-152d-416b-adf4-eca86141347e'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:02:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:02:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:02:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:02:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:02:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:02:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:02:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:02:38 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:02:38 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Deleted volume successfully. Sep 16 23:02:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-196513bf-62bf-4833-90ba-5c4b9964c285 tempest-VolumeQuotasNegativeTestJSON-262262838 None] Lock "cinder-35cd7e06-9ac1-4a03-a014-bb7909f0006a-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:02:48 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:02:48 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=10,cinder:SELECT=7,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:03:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:03:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:03:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:03:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:03:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:03:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:03:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.157s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:03:41 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (eed3a736-dc9c-48ab-af86-607501226c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5af3fb3-229a-4812-870d-a5d1e06d563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5af3fb3-229a-4812-870d-a5d1e06d563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569250628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e553d681-c82c-44be-8f3a-9a3f77484b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:03:41Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8aa5be-6819-4605-a362-5bea54005e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8aa5be-6819-4605-a362-5bea54005e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695e2a56-a2bd-48cd-9159-be784b619bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695e2a56-a2bd-48cd-9159-be784b619bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e553d681-c82c-44be-8f3a-9a3f77484b81', 'volume_name': 'volume-e553d681-c82c-44be-8f3a-9a3f77484b81', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cf16f4-7bc9-4689-8513-355a9d603023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cf16f4-7bc9-4689-8513-355a9d603023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6afea4a-f9e7-4a75-8449-7c23d523b52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:41 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Volume e553d681-c82c-44be-8f3a-9a3f77484b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e553d681-c82c-44be-8f3a-9a3f77484b81', 'volume_size': 1} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569250628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e553d681-c82c-44be-8f3a-9a3f77484b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:03:41Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Creating volume e553d681-c82c-44be-8f3a-9a3f77484b81 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:03:41 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e553d681-c82c-44be-8f3a-9a3f77484b81 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:41 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=131, name=volume-e553d681-c82c-44be-8f3a-9a3f77484b81, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e553d681-c82c-44be-8f3a-9a3f77484b81 1073741824" returned: 0 in 0.366s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e553d681-c82c-44be-8f3a-9a3f77484b81 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e553d681-c82c-44be-8f3a-9a3f77484b81" returned: 0 in 0.090s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] <== create_volume: return (535ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:03:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.549s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:03:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6afea4a-f9e7-4a75-8449-7c23d523b52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e553d681-c82c-44be-8f3a-9a3f77484b81', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702cbabe-272b-4c92-b947-7fda9e6417b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:42 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Volume volume-e553d681-c82c-44be-8f3a-9a3f77484b81 (e553d681-c82c-44be-8f3a-9a3f77484b81): created successfully Sep 16 23:03:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702cbabe-272b-4c92-b947-7fda9e6417b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (eed3a736-dc9c-48ab-af86-607501226c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:03:42 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-01707604-41a8-4afc-9ac1-41a762f1c041 tempest-VolumesActionsTest-1205063581 None] Created volume successfully. Sep 16 23:03:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-88c2a3e9-4dda-46b4-8098-f20aa1b2bb24 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81" by "attach_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:03:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-88c2a3e9-4dda-46b4-8098-f20aa1b2bb24 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81" acquired by "attach_volume" :: waited 0.052s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:03:43 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-88c2a3e9-4dda-46b4-8098-f20aa1b2bb24 tempest-VolumesActionsTest-1205063581 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:03:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-88c2a3e9-4dda-46b4-8098-f20aa1b2bb24 tempest-VolumesActionsTest-1205063581 None] Attaching volume e553d681-c82c-44be-8f3a-9a3f77484b81 to instance eba4f834-ce18-4bb4-b905-aca15e438fb3 at mountpoint /dev/vdb on host None. Sep 16 23:03:43 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-88c2a3e9-4dda-46b4-8098-f20aa1b2bb24 tempest-VolumesActionsTest-1205063581 None] Attach volume completed successfully. Sep 16 23:03:43 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-88c2a3e9-4dda-46b4-8098-f20aa1b2bb24 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81" released by "attach_volume" :: held 0.366s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:03:44 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-443b4363-66a6-42f5-ab57-6671ad6b52ba tempest-VolumesActionsTest-1828177052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:03:44 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-443b4363-66a6-42f5-ab57-6671ad6b52ba tempest-VolumesActionsTest-1828177052 None] Terminate volume connection completed successfully. Sep 16 23:03:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-443b4363-66a6-42f5-ab57-6671ad6b52ba tempest-VolumesActionsTest-1828177052 None] Acquiring lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81-detach_volume" by "detach_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:03:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-443b4363-66a6-42f5-ab57-6671ad6b52ba tempest-VolumesActionsTest-1828177052 None] Lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:03:44 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-443b4363-66a6-42f5-ab57-6671ad6b52ba tempest-VolumesActionsTest-1828177052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:03:44 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-443b4363-66a6-42f5-ab57-6671ad6b52ba tempest-VolumesActionsTest-1828177052 None] Detaching volume e553d681-c82c-44be-8f3a-9a3f77484b81 from instance eba4f834-ce18-4bb4-b905-aca15e438fb3. Sep 16 23:03:44 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-443b4363-66a6-42f5-ab57-6671ad6b52ba tempest-VolumesActionsTest-1828177052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:03:44 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-443b4363-66a6-42f5-ab57-6671ad6b52ba tempest-VolumesActionsTest-1828177052 None] Detach volume completed successfully. Sep 16 23:03:44 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-443b4363-66a6-42f5-ab57-6671ad6b52ba tempest-VolumesActionsTest-1828177052 None] Lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81-detach_volume" released by "detach_volume" :: held 0.123s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:03:45 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8765807f-943a-4004-8957-4ab997012074 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81-detach_volume" by "detach_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:03:45 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8765807f-943a-4004-8957-4ab997012074 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:03:45 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8765807f-943a-4004-8957-4ab997012074 tempest-VolumesActionsTest-1205063581 None] Volume detach called, but volume not attached. Sep 16 23:03:45 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8765807f-943a-4004-8957-4ab997012074 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:03:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:03:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:03:46 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:03:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "cinder-quobyte-e553d681-c82c-44be-8f3a-9a3f77484b81" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:03:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-quobyte-e553d681-c82c-44be-8f3a-9a3f77484b81" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:03:46 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f1cca7-2fc6-4a0f-be4f-047326f5ae60]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:03:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e553d681-c82c-44be-8f3a-9a3f77484b81 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e553d681-c82c-44be-8f3a-9a3f77484b81" returned: 0 in 0.413s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e553d681-c82c-44be-8f3a-9a3f77484b81 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e553d681-c82c-44be-8f3a-9a3f77484b81" returned: 0 in 0.108s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:46 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-quobyte-e553d681-c82c-44be-8f3a-9a3f77484b81" released by "delete_volume" :: held 0.661s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:03:47 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Created reservations ['a94fa9b5-b44a-4d1e-990f-f673e1ba6575', '801e13f7-d46e-4d5b-8540-b753e6538b4d', 'dcdfb42c-0717-499b-befe-c621a91a0414', '8121d550-725b-45f0-83a5-7e5a1eca575d'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:03:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:03:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:03:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:03:47 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:03:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:03:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.152s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:47 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:03:47 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Deleted volume successfully. Sep 16 23:03:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-56d6ba01-a375-4e80-a863-a56d0be4ac25 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-e553d681-c82c-44be-8f3a-9a3f77484b81-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:03:56 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (d13f7e40-8a36-4290-84e6-bd4076b271c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f5e49e-a653-40f2-aeb5-d1a7f19dd81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f5e49e-a653-40f2-aeb5-d1a7f19dd81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-683628067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d26662-dbb3-4afd-8ebc-7c747da4ce38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:03:56Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc441e0-29c0-4141-94cb-8f3da0c74e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc441e0-29c0-4141-94cb-8f3da0c74e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c2f68e-03c6-41ee-8571-9be99a34fb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c2f68e-03c6-41ee-8571-9be99a34fb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d26662-dbb3-4afd-8ebc-7c747da4ce38', 'volume_name': 'volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9614f7e9-e296-47d7-aa0d-724a766f7eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9614f7e9-e296-47d7-aa0d-724a766f7eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9133ef-6757-45bf-891d-1a8a1a31a536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:56 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Volume c7d26662-dbb3-4afd-8ebc-7c747da4ce38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38', 'volume_size': 1} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-683628067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d26662-dbb3-4afd-8ebc-7c747da4ce38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:03:56Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Creating volume c7d26662-dbb3-4afd-8ebc-7c747da4ce38 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:03:56 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:56 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=132, name=volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38 1073741824" returned: 0 in 0.291s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38" returned: 0 in 0.084s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] <== create_volume: return (440ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:03:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.453s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:03:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9133ef-6757-45bf-891d-1a8a1a31a536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ba7041-075e-4756-97a4-537901b28b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:03:57 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Volume volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38 (c7d26662-dbb3-4afd-8ebc-7c747da4ce38): created successfully Sep 16 23:03:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ba7041-075e-4756-97a4-537901b28b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:03:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (d13f7e40-8a36-4290-84e6-bd4076b271c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:03:57 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-239227eb-5d81-40d2-8fdc-9d00134ebe6a tempest-VolumesActionsTest-1205063581 None] Created volume successfully. Sep 16 23:03:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Acquiring lock "cinder-c7d26662-dbb3-4afd-8ebc-7c747da4ce38-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:03:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Lock "cinder-c7d26662-dbb3-4afd-8ebc-7c747da4ce38-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:03:58 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:03:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Acquiring lock "cinder-quobyte-c7d26662-dbb3-4afd-8ebc-7c747da4ce38" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:03:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Lock "cinder-quobyte-c7d26662-dbb3-4afd-8ebc-7c747da4ce38" acquired by "delete_volume" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:03:58 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec58e14-e705-4ef9-8ee1-59f471720e71]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:03:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38" returned: 0 in 0.385s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c7d26662-dbb3-4afd-8ebc-7c747da4ce38" returned: 0 in 0.109s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Lock "cinder-quobyte-c7d26662-dbb3-4afd-8ebc-7c747da4ce38" released by "delete_volume" :: held 0.632s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Created reservations ['fd51077b-3ca7-4e35-9da0-6667884a9671', '554e2169-3ddc-4b6d-b78b-a7c65c3e2dea', 'b827b1dc-3a2c-425b-8885-d8240422dad1', 'aab0e82d-7aec-4a23-8530-087c8a5fcfa1'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.100s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:03:59 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:03:59 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Deleted volume successfully. Sep 16 23:04:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5e993ce9-3274-4727-a4a5-0d406f76838c tempest-VolumesActionsTest-1828177052 None] Lock "cinder-c7d26662-dbb3-4afd-8ebc-7c747da4ce38-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (0e06ca00-305e-46d7-9538-b0878c913f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec55371-014f-43f3-9d5a-b3900e1b5378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec55371-014f-43f3-9d5a-b3900e1b5378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1851853468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:01Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43e28e6-434e-4e62-a218-4582e0bc0d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43e28e6-434e-4e62-a218-4582e0bc0d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a55417f-b336-487e-a6bb-4711f535dc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a55417f-b336-487e-a6bb-4711f535dc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff', 'volume_name': 'volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0bc79f-28f6-4124-8301-adbb131a77ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0bc79f-28f6-4124-8301-adbb131a77ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5c2afc-ab5a-4492-9baa-235191497ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:01 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Volume 7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff', 'volume_size': 1} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1851853468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:01Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Creating volume 7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:04:01 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:01 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=133, name=volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff 1073741824" returned: 0 in 0.301s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] <== create_volume: return (451ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:04:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.462s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5c2afc-ab5a-4492-9baa-235191497ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25e8015-010b-4c42-8d72-be1958f742fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:02 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Volume volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff (7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff): created successfully Sep 16 23:04:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25e8015-010b-4c42-8d72-be1958f742fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (0e06ca00-305e-46d7-9538-b0878c913f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:02 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-1c50ed38-8dce-499d-a4df-8ba122774782 tempest-VolumesActionsTest-1205063581 None] Created volume successfully. Sep 16 23:04:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Acquiring lock "cinder-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Lock "cinder-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:03 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Acquiring lock "cinder-quobyte-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Lock "cinder-quobyte-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:03 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff4f110-476e-40cb-8c1a-62c1b5fa0a68]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:04:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff" returned: 0 in 0.532s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff" returned: 0 in 0.109s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Lock "cinder-quobyte-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff" released by "delete_volume" :: held 0.844s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Created reservations ['09bd8e4e-f39d-466d-af80-ebf5719814fe', 'caa64ccb-e360-452e-9e2b-a3d3e5fe70de', 'efda4ef8-1202-426d-b983-757bd12aa251', 'e8ded136-64ca-40e5-a9c4-f0b396f53105'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.079s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:05 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:04:05 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Deleted volume successfully. Sep 16 23:04:05 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd376c29-29b1-44b3-9db9-06d7040a5e6d tempest-VolumesActionsTest-1828177052 None] Lock "cinder-7a9e8096-1fef-4e3c-9dba-fbbc0d9744ff-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:06 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (b5e46852-1e46-42ef-a6f7-490a14dd31c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea4df39-9284-45d6-9078-c5900be721a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea4df39-9284-45d6-9078-c5900be721a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1120322525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69812d89-3be6-414a-aa38-ffbafe9e74a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:06Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ad03c2-45fd-45c9-84cf-910db7e2a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ad03c2-45fd-45c9-84cf-910db7e2a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba23dce7-672a-4efb-b675-240291bb9efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba23dce7-672a-4efb-b675-240291bb9efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69812d89-3be6-414a-aa38-ffbafe9e74a5', 'volume_name': 'volume-69812d89-3be6-414a-aa38-ffbafe9e74a5', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1de6a7a-8f48-47c0-a4d3-8bcc10022cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1de6a7a-8f48-47c0-a4d3-8bcc10022cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20c488d-0281-4ca2-ba25-36d2535c3e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:06 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Volume 69812d89-3be6-414a-aa38-ffbafe9e74a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69812d89-3be6-414a-aa38-ffbafe9e74a5', 'volume_size': 1} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1120322525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69812d89-3be6-414a-aa38-ffbafe9e74a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:06Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Creating volume 69812d89-3be6-414a-aa38-ffbafe9e74a5 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:04:06 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-69812d89-3be6-414a-aa38-ffbafe9e74a5 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:06 devstack quobyte-client[83246]: System call of process 97945 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:04:06 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=134, name=volume-69812d89-3be6-414a-aa38-ffbafe9e74a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-69812d89-3be6-414a-aa38-ffbafe9e74a5 1073741824" returned: 0 in 0.295s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-69812d89-3be6-414a-aa38-ffbafe9e74a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-69812d89-3be6-414a-aa38-ffbafe9e74a5" returned: 0 in 0.085s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] <== create_volume: return (444ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.456s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20c488d-0281-4ca2-ba25-36d2535c3e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69812d89-3be6-414a-aa38-ffbafe9e74a5', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c76ee2a-bc91-4fb4-9192-f4b819c6f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:07 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Volume volume-69812d89-3be6-414a-aa38-ffbafe9e74a5 (69812d89-3be6-414a-aa38-ffbafe9e74a5): created successfully Sep 16 23:04:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c76ee2a-bc91-4fb4-9192-f4b819c6f47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (b5e46852-1e46-42ef-a6f7-490a14dd31c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:07 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e8fccf88-59d6-4cf1-aff1-1880340118ae tempest-VolumesActionsTest-1205063581 None] Created volume successfully. Sep 16 23:04:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Acquiring lock "cinder-69812d89-3be6-414a-aa38-ffbafe9e74a5-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Lock "cinder-69812d89-3be6-414a-aa38-ffbafe9e74a5-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:08 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Acquiring lock "cinder-quobyte-69812d89-3be6-414a-aa38-ffbafe9e74a5" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Lock "cinder-quobyte-69812d89-3be6-414a-aa38-ffbafe9e74a5" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:08 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29c4c0b-bc77-45f5-88c5-4d3bb99728a9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:04:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-69812d89-3be6-414a-aa38-ffbafe9e74a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-69812d89-3be6-414a-aa38-ffbafe9e74a5" returned: 0 in 0.377s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-69812d89-3be6-414a-aa38-ffbafe9e74a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-69812d89-3be6-414a-aa38-ffbafe9e74a5" returned: 0 in 0.115s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Lock "cinder-quobyte-69812d89-3be6-414a-aa38-ffbafe9e74a5" released by "delete_volume" :: held 0.646s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Created reservations ['13133ff0-efd7-4997-9222-f183a8802473', 'c9dbaf45-c071-4975-8b8f-90e052dffd39', '8b259dd7-fd09-4b52-afe6-5faddbcb652d', '37665d96-8554-4de8-af3c-f43bb0d0b540'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.114s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:09 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:04:09 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Deleted volume successfully. Sep 16 23:04:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-c15b5975-e11c-4ade-a1fc-029c4c39494d tempest-VolumesActionsTest-1828177052 None] Lock "cinder-69812d89-3be6-414a-aa38-ffbafe9e74a5-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (67f3107f-0eb7-4fa2-94a4-d8a8b4315621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777333d3-0c91-408f-910f-3ed0a982e53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777333d3-0c91-408f-910f-3ed0a982e53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1529808070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41e0ece-fa0d-4e0e-aad8-bd7428d0a158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:11Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7c6be1-c069-4a24-9e38-913b0b5abcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7c6be1-c069-4a24-9e38-913b0b5abcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a826d11-b4ab-4564-8145-76a9b898b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a826d11-b4ab-4564-8145-76a9b898b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41e0ece-fa0d-4e0e-aad8-bd7428d0a158', 'volume_name': 'volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e8f337-6b0c-44de-850c-9e28605cc8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e8f337-6b0c-44de-850c-9e28605cc8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97510e5b-6f6d-4127-9dce-d70051a8fb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:11 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Volume a41e0ece-fa0d-4e0e-aad8-bd7428d0a158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158', 'volume_size': 1} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1529808070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41e0ece-fa0d-4e0e-aad8-bd7428d0a158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:11Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Creating volume a41e0ece-fa0d-4e0e-aad8-bd7428d0a158 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:04:11 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:11 devstack quobyte-client[83246]: System call of process 97955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:04:11 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=135, name=volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158 1073741824" returned: 0 in 0.295s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158" returned: 0 in 0.096s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] <== create_volume: return (451ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.463s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97510e5b-6f6d-4127-9dce-d70051a8fb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154c4a35-d45e-4efd-82a8-9127ba8eab49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:11 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Volume volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158 (a41e0ece-fa0d-4e0e-aad8-bd7428d0a158): created successfully Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154c4a35-d45e-4efd-82a8-9127ba8eab49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (67f3107f-0eb7-4fa2-94a4-d8a8b4315621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-121b7a03-fc8c-4fc9-9a36-be76bd23a1cf tempest-VolumesActionsTest-1205063581 None] Created volume successfully. Sep 16 23:04:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Acquiring lock "cinder-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Lock "cinder-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:12 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Acquiring lock "cinder-quobyte-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:12 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Lock "cinder-quobyte-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158" acquired by "delete_volume" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:12 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd60bd6-ac4e-42b0-8d88-287b0c07e44f]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:04:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158" returned: 0 in 0.388s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158" returned: 0 in 0.110s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Lock "cinder-quobyte-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158" released by "delete_volume" :: held 0.639s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Created reservations ['b32df4fd-5937-4bb7-92b8-eeaa5048f9cb', 'c56ab57b-57d3-4ef1-b225-22537a3fffe2', 'e620fd15-7c7f-4ae4-b599-f7d665d95078', '162edf4e-96d4-45d0-97a0-150bd9948a50'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.103s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:04:13 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Deleted volume successfully. Sep 16 23:04:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-3bf34289-0487-43b6-bf01-b686de58b557 tempest-VolumesActionsTest-1828177052 None] Lock "cinder-a41e0ece-fa0d-4e0e-aad8-bd7428d0a158-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (6916fd2e-7cac-45e2-b074-d3ea9a2a9425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a66095b-bfb7-49b9-9683-067ce5dec8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a66095b-bfb7-49b9-9683-067ce5dec8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1478420466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cfeb34-6344-4ca9-99e5-94a99308b5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:15Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa38d545-227e-4a51-a1cc-5fc978349387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa38d545-227e-4a51-a1cc-5fc978349387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d67aa9d-e471-4ad2-998b-8f9aa932b037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d67aa9d-e471-4ad2-998b-8f9aa932b037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19cfeb34-6344-4ca9-99e5-94a99308b5de', 'volume_name': 'volume-19cfeb34-6344-4ca9-99e5-94a99308b5de', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c261fd-07b0-495b-a7cd-fb948b4fc958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c261fd-07b0-495b-a7cd-fb948b4fc958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b93a18-ee14-447f-a089-e88af81b2a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:15 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Volume 19cfeb34-6344-4ca9-99e5-94a99308b5de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19cfeb34-6344-4ca9-99e5-94a99308b5de', 'volume_size': 1} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1478420466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cfeb34-6344-4ca9-99e5-94a99308b5de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d3041591d64c44ad5a75f937d6b9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:15Z,use_quota=True,user_id='41393ad8b28d4d3c9bd9fcbdd45b46ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Creating volume 19cfeb34-6344-4ca9-99e5-94a99308b5de {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:04:15 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-19cfeb34-6344-4ca9-99e5-94a99308b5de 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:15 devstack quobyte-client[83246]: System call of process 97965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:04:15 devstack quobyte-client[83246]: System call of process 97965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:04:15 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=136, name=volume-19cfeb34-6344-4ca9-99e5-94a99308b5de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-19cfeb34-6344-4ca9-99e5-94a99308b5de 1073741824" returned: 0 in 0.321s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-19cfeb34-6344-4ca9-99e5-94a99308b5de {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-19cfeb34-6344-4ca9-99e5-94a99308b5de" returned: 0 in 0.111s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] <== create_volume: return (532ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.552s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b93a18-ee14-447f-a089-e88af81b2a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19cfeb34-6344-4ca9-99e5-94a99308b5de', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e15fac-8b86-46c1-88ae-b246fdb1f40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:16 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Volume volume-19cfeb34-6344-4ca9-99e5-94a99308b5de (19cfeb34-6344-4ca9-99e5-94a99308b5de): created successfully Sep 16 23:04:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e15fac-8b86-46c1-88ae-b246fdb1f40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Flow 'volume_create_manager' (6916fd2e-7cac-45e2-b074-d3ea9a2a9425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-32222872-274e-4551-99ae-07d816d067d9 tempest-VolumesActionsTest-1205063581 None] Created volume successfully. Sep 16 23:04:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "cinder-19cfeb34-6344-4ca9-99e5-94a99308b5de-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-19cfeb34-6344-4ca9-99e5-94a99308b5de-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:18 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "cinder-quobyte-19cfeb34-6344-4ca9-99e5-94a99308b5de" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-quobyte-19cfeb34-6344-4ca9-99e5-94a99308b5de" acquired by "delete_volume" :: waited 0.013s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:18 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d591cc1-251e-4403-80b3-8909b4bb7af2]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:04:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-19cfeb34-6344-4ca9-99e5-94a99308b5de {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-19cfeb34-6344-4ca9-99e5-94a99308b5de" returned: 0 in 0.418s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-19cfeb34-6344-4ca9-99e5-94a99308b5de {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-19cfeb34-6344-4ca9-99e5-94a99308b5de" returned: 0 in 0.089s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-quobyte-19cfeb34-6344-4ca9-99e5-94a99308b5de" released by "delete_volume" :: held 0.658s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:18 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Created reservations ['70768f1a-713d-4e11-aeb1-085092ac9d5b', 'bd52983a-7623-40e7-af3f-3d292ee6e280', 'ebec49e0-49e4-4df8-bcca-8dc6bd061da0', '51d95bb9-bf5e-4a56-82d8-c5a4facdec7d'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:04:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.089s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:19 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:04:19 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Deleted volume successfully. Sep 16 23:04:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-726d6fc5-4141-4fb8-a16d-5bf41745f005 tempest-VolumesActionsTest-1205063581 None] Lock "cinder-19cfeb34-6344-4ca9-99e5-94a99308b5de-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:04:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.093s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:04:29 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=39,cinder:UPDATE=62,cinder:DELETE=7,cinder:INSERT=8 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:04:29 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=66,cinder:SELECT=49,cinder:INSERT=18,cinder:DELETE=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:04:34 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Flow 'volume_create_manager' (b80e69a9-0a09-4dcf-ab1d-18bef5aa7262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a575426f-b800-47db-b6af-50da0f6c3b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a575426f-b800-47db-b6af-50da0f6c3b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-4561364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=737fdb38-fb17-4791-aa64-c6817bcb6529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a793713a594d5a935c3783b31bac13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:35Z,use_quota=True,user_id='ce207809afbe49db9a04df382f4ec974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d570c9dc-7d47-4b94-9701-f32dc6bf05b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d570c9dc-7d47-4b94-9701-f32dc6bf05b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1926026a-896b-4c3b-818e-dcdc32e07b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1926026a-896b-4c3b-818e-dcdc32e07b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '737fdb38-fb17-4791-aa64-c6817bcb6529', 'volume_name': 'volume-737fdb38-fb17-4791-aa64-c6817bcb6529', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d797e8ea-bb66-4b90-9a03-7b47170422c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d797e8ea-bb66-4b90-9a03-7b47170422c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c8dd70-67b3-4857-bcf4-418675290429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:34 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Volume 737fdb38-fb17-4791-aa64-c6817bcb6529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-737fdb38-fb17-4791-aa64-c6817bcb6529', 'volume_size': 1} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-4561364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=737fdb38-fb17-4791-aa64-c6817bcb6529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a793713a594d5a935c3783b31bac13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:35Z,use_quota=True,user_id='ce207809afbe49db9a04df382f4ec974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Creating volume 737fdb38-fb17-4791-aa64-c6817bcb6529 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:04:34 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:04:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-737fdb38-fb17-4791-aa64-c6817bcb6529 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:35 devstack quobyte-client[83246]: System call of process 97986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:04:35 devstack quobyte-client[83246]: System call of process 97986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:04:35 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=137, name=volume-737fdb38-fb17-4791-aa64-c6817bcb6529, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:04:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-737fdb38-fb17-4791-aa64-c6817bcb6529 1073741824" returned: 0 in 0.314s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-737fdb38-fb17-4791-aa64-c6817bcb6529 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-737fdb38-fb17-4791-aa64-c6817bcb6529" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] <== create_volume: return (471ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:04:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.484s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c8dd70-67b3-4857-bcf4-418675290429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-737fdb38-fb17-4791-aa64-c6817bcb6529', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4a5d94-dfea-4d61-bd73-05cc500538e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:35 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Volume volume-737fdb38-fb17-4791-aa64-c6817bcb6529 (737fdb38-fb17-4791-aa64-c6817bcb6529): created successfully Sep 16 23:04:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4a5d94-dfea-4d61-bd73-05cc500538e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:35 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Flow 'volume_create_manager' (b80e69a9-0a09-4dcf-ab1d-18bef5aa7262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:35 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8de4db36-e866-4256-b92a-3b507dd62fa6 tempest-AbsoluteLimitsTests-471265014 None] Created volume successfully. Sep 16 23:04:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Acquiring lock "cinder-737fdb38-fb17-4791-aa64-c6817bcb6529-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Lock "cinder-737fdb38-fb17-4791-aa64-c6817bcb6529-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:37 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Acquiring lock "cinder-quobyte-737fdb38-fb17-4791-aa64-c6817bcb6529" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Lock "cinder-quobyte-737fdb38-fb17-4791-aa64-c6817bcb6529" acquired by "delete_volume" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:37 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e33df4-dad5-471d-afbf-f3ebeb9edb45]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:04:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-737fdb38-fb17-4791-aa64-c6817bcb6529 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-737fdb38-fb17-4791-aa64-c6817bcb6529" returned: 0 in 0.373s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-737fdb38-fb17-4791-aa64-c6817bcb6529 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-737fdb38-fb17-4791-aa64-c6817bcb6529" returned: 0 in 0.112s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Lock "cinder-quobyte-737fdb38-fb17-4791-aa64-c6817bcb6529" released by "delete_volume" :: held 0.627s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:38 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Created reservations ['241734c0-1b44-4203-8a2e-73a31e710b50', 'f71e2ec0-6a30-4aa1-a060-bcba2e5b6e90', 'e950ca6d-d7f2-4dad-b517-c2e9e4af1652', '7428ab5a-49ba-43fc-9059-30baf12ffafd'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:04:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:38 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:38 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.100s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:38 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:04:38 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Deleted volume successfully. Sep 16 23:04:38 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40fca1fa-c076-4036-b909-1202a869d6aa tempest-AbsoluteLimitsTests-471265014 None] Lock "cinder-737fdb38-fb17-4791-aa64-c6817bcb6529-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:43 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:43 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Flow 'volume_create_manager' (374ce6d5-c628-4b45-8ceb-a9ac1448e3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6baf932-c082-4e84-a52c-a7fddc496c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6baf932-c082-4e84-a52c-a7fddc496c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-358532634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3fb297-621c-4cd4-ba23-dcf01b6eecfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c782d10a6c4b0c809b1c4c9673211c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:44Z,use_quota=True,user_id='9ce2c2849f524b258e6ac68e4d8aa0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbefb792-0df6-4c36-888f-ae43c8ec27c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbefb792-0df6-4c36-888f-ae43c8ec27c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9298fb43-a1d5-4c60-836f-31168e8eaf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9298fb43-a1d5-4c60-836f-31168e8eaf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3fb297-621c-4cd4-ba23-dcf01b6eecfc', 'volume_name': 'volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2417af19-a6a3-45f3-8a3a-759cb1747c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2417af19-a6a3-45f3-8a3a-759cb1747c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090a988f-0e3c-46a0-a544-75c03b7266fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:44 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Volume 8a3fb297-621c-4cd4-ba23-dcf01b6eecfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc', 'volume_size': 1} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-358532634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3fb297-621c-4cd4-ba23-dcf01b6eecfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c782d10a6c4b0c809b1c4c9673211c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:44Z,use_quota=True,user_id='9ce2c2849f524b258e6ac68e4d8aa0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Creating volume 8a3fb297-621c-4cd4-ba23-dcf01b6eecfc {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:04:44 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:44 devstack quobyte-client[83246]: System call of process 97996 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:04:44 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=138, name=volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc 1073741824" returned: 0 in 0.317s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc" returned: 0 in 0.090s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] <== create_volume: return (471ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.484s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090a988f-0e3c-46a0-a544-75c03b7266fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493f3937-abe5-4d94-9fec-17e46da56d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:44 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Volume volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc (8a3fb297-621c-4cd4-ba23-dcf01b6eecfc): created successfully Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493f3937-abe5-4d94-9fec-17e46da56d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Flow 'volume_create_manager' (374ce6d5-c628-4b45-8ceb-a9ac1448e3b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:44 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0bdaecc2-226e-438b-88f7-120edfea7fbf tempest-VolumesTransfersTest-436919257 None] Created volume successfully. Sep 16 23:04:46 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b09319c2-625c-4f70-a7bf-4ec9416acdfd tempest-VolumesTransfersTest-993700429 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:46 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b09319c2-625c-4f70-a7bf-4ec9416acdfd tempest-VolumesTransfersTest-993700429 None] Transfer volume completed successfully. Sep 16 23:04:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Acquiring lock "cinder-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Lock "cinder-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:47 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Acquiring lock "cinder-quobyte-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Lock "cinder-quobyte-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc" acquired by "delete_volume" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:47 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe2ce3e-de35-4f86-8ffd-eb57bcd90eae]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:04:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc" returned: 0 in 0.398s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc" returned: 0 in 0.107s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Lock "cinder-quobyte-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc" released by "delete_volume" :: held 0.646s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Created reservations ['199e583c-aa6d-4c46-b5b3-a1cf8eee77c5', '08dfe502-9487-4bb3-95c0-3947b846091d', '8ff82fbe-e89b-47f7-99a6-77ea3169bfeb', '93675da5-dcc3-4668-aa47-ee819c35f2c5'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.175s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:48 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:04:49 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Deleted volume successfully. Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-81e807ea-341d-49c6-8729-ca32907f8dc7 tempest-VolumesTransfersTest-1698057486 None] Lock "cinder-8a3fb297-621c-4cd4-ba23-dcf01b6eecfc-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:49 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Flow 'volume_create_manager' (37d89c97-0616-4caf-8fd3-54d98370401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53ec0f1-3c12-4f50-9b30-6ae721bf6a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53ec0f1-3c12-4f50-9b30-6ae721bf6a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1774562748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abeb38ca-059a-43de-9326-d068d25d39fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c782d10a6c4b0c809b1c4c9673211c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:49Z,use_quota=True,user_id='9ce2c2849f524b258e6ac68e4d8aa0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9984db0-26e1-4376-a7e2-72019c7c8668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9984db0-26e1-4376-a7e2-72019c7c8668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea928e5-dd42-4d07-a807-efbd9d91d333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea928e5-dd42-4d07-a807-efbd9d91d333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abeb38ca-059a-43de-9326-d068d25d39fd', 'volume_name': 'volume-abeb38ca-059a-43de-9326-d068d25d39fd', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c693cb3-1f89-4992-8a3c-a87567d259c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c693cb3-1f89-4992-8a3c-a87567d259c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a5dba3-dda1-4a78-b2e8-46a24aa5e28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:49 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Volume abeb38ca-059a-43de-9326-d068d25d39fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abeb38ca-059a-43de-9326-d068d25d39fd', 'volume_size': 1} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1774562748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abeb38ca-059a-43de-9326-d068d25d39fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c782d10a6c4b0c809b1c4c9673211c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:04:49Z,use_quota=True,user_id='9ce2c2849f524b258e6ac68e4d8aa0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Creating volume abeb38ca-059a-43de-9326-d068d25d39fd {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:04:49 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-abeb38ca-059a-43de-9326-d068d25d39fd 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:49 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=139, name=volume-abeb38ca-059a-43de-9326-d068d25d39fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-abeb38ca-059a-43de-9326-d068d25d39fd 1073741824" returned: 0 in 0.286s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-abeb38ca-059a-43de-9326-d068d25d39fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-abeb38ca-059a-43de-9326-d068d25d39fd" returned: 0 in 0.078s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] <== create_volume: return (427ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:04:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.439s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a5dba3-dda1-4a78-b2e8-46a24aa5e28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abeb38ca-059a-43de-9326-d068d25d39fd', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a52a8ed-346e-48d4-a852-4ab4fd1ae6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:04:50 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Volume volume-abeb38ca-059a-43de-9326-d068d25d39fd (abeb38ca-059a-43de-9326-d068d25d39fd): created successfully Sep 16 23:04:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a52a8ed-346e-48d4-a852-4ab4fd1ae6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:04:50 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Flow 'volume_create_manager' (37d89c97-0616-4caf-8fd3-54d98370401f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:04:50 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-c37adf55-76cb-4e55-a3da-25bf30a843f5 tempest-VolumesTransfersTest-436919257 None] Created volume successfully. Sep 16 23:04:50 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Acquiring lock "cinder-abeb38ca-059a-43de-9326-d068d25d39fd-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:50 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Lock "cinder-abeb38ca-059a-43de-9326-d068d25d39fd-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:50 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:04:50 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Acquiring lock "cinder-quobyte-abeb38ca-059a-43de-9326-d068d25d39fd" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:04:50 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Lock "cinder-quobyte-abeb38ca-059a-43de-9326-d068d25d39fd" acquired by "delete_volume" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:04:51 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d41892-b39d-49b2-948d-efba07e65782]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:04:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-abeb38ca-059a-43de-9326-d068d25d39fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-abeb38ca-059a-43de-9326-d068d25d39fd" returned: 0 in 0.376s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-abeb38ca-059a-43de-9326-d068d25d39fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-abeb38ca-059a-43de-9326-d068d25d39fd" returned: 0 in 0.096s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Lock "cinder-quobyte-abeb38ca-059a-43de-9326-d068d25d39fd" released by "delete_volume" :: held 0.612s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:04:51 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Created reservations ['f6d24256-7f58-41ad-8065-35cb6974f3ba', '4f341ce9-8db7-4673-bdb0-5ed4533cb180', 'b6642b68-9e14-477d-9710-c9aad10d27a2', 'dbd51a46-9f68-4e75-a019-ecf4523d14fb'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:04:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:04:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:04:51 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:04:52 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:04:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:04:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:04:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.096s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:04:52 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:04:52 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Deleted volume successfully. Sep 16 23:04:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-416836be-be11-458c-bc44-87996f00af05 tempest-VolumesTransfersTest-1698057486 None] Lock "cinder-abeb38ca-059a-43de-9326-d068d25d39fd-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:05:01 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:05:02 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=20,cinder:UPDATE=39,cinder:INSERT=8,cinder:DELETE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:05:06 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Flow 'volume_create_manager' (f6d5bd0d-0983-49cb-ba24-332f8c530232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa3e730-7a54-443c-b1b3-7576ccd51afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa3e730-7a54-443c-b1b3-7576ccd51afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1944523836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1171c0ce10834833a03263f8d46e4da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:05:06Z,use_quota=True,user_id='6fbed38b99a349c38b0bd53b9c78dc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae7e0c7-e980-4da8-b8d9-abb1541f46fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae7e0c7-e980-4da8-b8d9-abb1541f46fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6e4868-8f72-40b9-90fc-d534d487f259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6e4868-8f72-40b9-90fc-d534d487f259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5', 'volume_name': 'volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e782ca-5042-432c-bd86-2d17bbf27325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e782ca-5042-432c-bd86-2d17bbf27325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4c7c86-1da0-4bb9-9ebd-6ce1cf54ed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:05:06 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Volume 5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5', 'volume_size': 1} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1944523836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1171c0ce10834833a03263f8d46e4da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:05:06Z,use_quota=True,user_id='6fbed38b99a349c38b0bd53b9c78dc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Creating volume 5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:05:06 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:05:06 devstack quobyte-client[83246]: System call of process 98056 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:05:06 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=140, name=volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 1073741824" returned: 0 in 0.405s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" returned: 0 in 0.127s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] <== create_volume: return (606ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:05:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.624s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:05:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4c7c86-1da0-4bb9-9ebd-6ce1cf54ed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:05:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e560f73f-fcf3-4f84-8ae7-591ffff5acb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:05:07 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Volume volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 (5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5): created successfully Sep 16 23:05:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e560f73f-fcf3-4f84-8ae7-591ffff5acb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:05:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Flow 'volume_create_manager' (f6d5bd0d-0983-49cb-ba24-332f8c530232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:05:07 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-f6537403-8d15-460b-984c-a2d007a4eb5e tempest-VolumesActionsTest-1305758709 None] Created volume successfully. Sep 16 23:05:17 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:05:17 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:05:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:05:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:05:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:05:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:05:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:05:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:05:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:05:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.108s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:05:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:05:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-36affdc4-c97b-4e65-b4a9-77bc7cc9a572 tempest-VolumesActionsTest-1305758709 None] Acquiring lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" by "attach_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:05:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-36affdc4-c97b-4e65-b4a9-77bc7cc9a572 tempest-VolumesActionsTest-1305758709 None] Lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" acquired by "attach_volume" :: waited 0.068s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:05:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-36affdc4-c97b-4e65-b4a9-77bc7cc9a572 tempest-VolumesActionsTest-1305758709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:05:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-36affdc4-c97b-4e65-b4a9-77bc7cc9a572 tempest-VolumesActionsTest-1305758709 None] Attaching volume 5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 to instance 346866bd-d60c-441e-a810-171deb9d0659 at mountpoint /dev/vdb on host None. Sep 16 23:05:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-36affdc4-c97b-4e65-b4a9-77bc7cc9a572 tempest-VolumesActionsTest-1305758709 None] Attach volume completed successfully. Sep 16 23:05:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-36affdc4-c97b-4e65-b4a9-77bc7cc9a572 tempest-VolumesActionsTest-1305758709 None] Lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" released by "attach_volume" :: held 0.342s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:05:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ea16541d-92af-4999-922f-1d73159b9821 tempest-VolumesActionsTest-1305758709 None] Acquiring lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5-detach_volume" by "detach_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:05:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ea16541d-92af-4999-922f-1d73159b9821 tempest-VolumesActionsTest-1305758709 None] Lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:05:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ea16541d-92af-4999-922f-1d73159b9821 tempest-VolumesActionsTest-1305758709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:05:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ea16541d-92af-4999-922f-1d73159b9821 tempest-VolumesActionsTest-1305758709 None] Detaching volume 5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 from instance 346866bd-d60c-441e-a810-171deb9d0659. Sep 16 23:05:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ea16541d-92af-4999-922f-1d73159b9821 tempest-VolumesActionsTest-1305758709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:05:30 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ea16541d-92af-4999-922f-1d73159b9821 tempest-VolumesActionsTest-1305758709 None] Detach volume completed successfully. Sep 16 23:05:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-ea16541d-92af-4999-922f-1d73159b9821 tempest-VolumesActionsTest-1305758709 None] Lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:05:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:05:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:06:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-02064103-56b8-4fa5-b4b9-5133e61129f0 tempest-VolumesActionsTest-1305758709 None] Acquiring lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" by "attach_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:06:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-02064103-56b8-4fa5-b4b9-5133e61129f0 tempest-VolumesActionsTest-1305758709 None] Lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" acquired by "attach_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:06:00 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-02064103-56b8-4fa5-b4b9-5133e61129f0 tempest-VolumesActionsTest-1305758709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:06:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-02064103-56b8-4fa5-b4b9-5133e61129f0 tempest-VolumesActionsTest-1305758709 None] Attaching volume 5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 to instance 5ea9ade3-9cde-4793-9f0e-4df2c79d11e8 at mountpoint /dev/vdb on host None. Sep 16 23:06:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-02064103-56b8-4fa5-b4b9-5133e61129f0 tempest-VolumesActionsTest-1305758709 None] Attach volume completed successfully. Sep 16 23:06:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-02064103-56b8-4fa5-b4b9-5133e61129f0 tempest-VolumesActionsTest-1305758709 None] Lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" released by "attach_volume" :: held 0.105s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:06:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b860c683-2b40-453c-8938-347ba923b76b tempest-VolumesActionsTest-1305758709 None] Acquiring lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5-detach_volume" by "detach_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:06:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b860c683-2b40-453c-8938-347ba923b76b tempest-VolumesActionsTest-1305758709 None] Lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:06:00 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b860c683-2b40-453c-8938-347ba923b76b tempest-VolumesActionsTest-1305758709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:06:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b860c683-2b40-453c-8938-347ba923b76b tempest-VolumesActionsTest-1305758709 None] Detaching volume 5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 from instance 5ea9ade3-9cde-4793-9f0e-4df2c79d11e8. Sep 16 23:06:00 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-b860c683-2b40-453c-8938-347ba923b76b tempest-VolumesActionsTest-1305758709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:06:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-b860c683-2b40-453c-8938-347ba923b76b tempest-VolumesActionsTest-1305758709 None] Detach volume completed successfully. Sep 16 23:06:00 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-b860c683-2b40-453c-8938-347ba923b76b tempest-VolumesActionsTest-1305758709 None] Lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:06:10 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:06:10 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:06:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:06:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:06:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:06:11 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ad868a-7f3d-437a-b102-c5a84e575d28]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:06:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:06:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" returned: 0 in 0.384s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:06:11 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[612065c0-fb52-4ccf-b0e5-dd1f3f3300e1]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:06:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:06:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" returned: 0 in 0.385s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:06:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.130a347a-78a5-4b4a-85b4-6570246e12aediex2622.img {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:06:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.130a347a-78a5-4b4a-85b4-6570246e12aediex2622.img" returned: 0 in 4.124s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:06:16 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef14a01a-c941-4b96-b2d8-e5f056804b7d]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:06:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:06:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" returned: 0 in 0.509s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:06:16 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.130a347a-78a5-4b4a-85b4-6570246e12aediex2622.img {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 23:06:16 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Converted 1024.00 MB image at 246.91 MB/s Sep 16 23:06:16 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] 130a347a-78a5-4b4a-85b4-6570246e12ae was raw, no need to convert to raw {{(pid=83223) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 16 23:06:21 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:06:26 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=2 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:06:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:06:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:06:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:06:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:06:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:06:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:06:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:06:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.168s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:06:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:06:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 40.513s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:06:51 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Uploaded volume to glance image-id: 130a347a-78a5-4b4a-85b4-6570246e12ae. {{(pid=83223) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 16 23:06:51 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-cc2e67b1-4126-48d1-b3c5-fe81c37769ae tempest-VolumesActionsTest-1305758709 None] Copy volume to image completed successfully. Sep 16 23:06:53 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:06:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:06:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:06:53 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d124ff60-66b2-442e-a769-6dae9c1fe13b]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:06:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:06:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" returned: 0 in 0.405s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:06:54 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb33598-7317-4792-9571-1ec7fe58d1ab]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:06:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:06:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" returned: 0 in 0.453s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:06:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:06:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img" returned: 0 in 4.665s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:06:59 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf412f84-5b17-4dc5-802d-c0b03f6cf34a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:06:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:06:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" returned: 0 in 0.503s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:06:59 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 23:06:59 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Converted 1024.00 MB image at 218.28 MB/s Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] 34ce3354-c7b3-4c07-9661-4addf424942d was raw, converting to qcow2 {{(pid=83223) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[65267bcb-c799-4154-9341-08d5fc65d5b5]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img" returned: 0 in 0.336s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img" returned: 1 in 0.330s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img /opt/stack/data/cinder/conversion/vol_upload_fyofq89x {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img /opt/stack/data/cinder/conversion/vol_upload_fyofq89x" returned: 0 in 0.145s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Image conversion details: src /opt/stack/data/cinder/conversion/5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5.temp_image.34ce3354-c7b3-4c07-9661-4addf424942dg2fgjoll.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fyofq89x {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 23:07:00 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[91442c50-b290-4419-84b4-b33a13704b66]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:07:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fyofq89x {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fyofq89x" returned: 0 in 0.351s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.723s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:07:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Uploaded volume to glance image-id: 34ce3354-c7b3-4c07-9661-4addf424942d. {{(pid=83223) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 16 23:07:02 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-831a8174-a9eb-4873-992a-41babada2e0c tempest-VolumesActionsTest-1305758709 None] Copy volume to image completed successfully. Sep 16 23:07:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Acquiring lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:07:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:07:04 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:07:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Acquiring lock "cinder-quobyte-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:07:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Lock "cinder-quobyte-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" acquired by "delete_volume" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:07:04 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b08b9e5-f991-49b1-8490-6757a36d2afa]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:07:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" returned: 0 in 0.394s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" returned: 0 in 0.101s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Lock "cinder-quobyte-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5" released by "delete_volume" :: held 0.633s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:07:05 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Created reservations ['4f663401-5d95-4ba8-b259-fb17e7cbf727', '3b8e5975-e674-4631-a129-d0e56e5c233e', '3358b8ed-5c2f-415e-bbf3-9975710e9a38', '301f5552-dace-4a0a-82a8-07bb2ec63a44'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:07:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:07:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:07:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:07:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:07:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:07:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.126s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:05 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:07:05 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Deleted volume successfully. Sep 16 23:07:05 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-2ca56cc4-be85-4fd1-b1cd-04001db3e2d9 tempest-VolumesActionsTest-1305758709 None] Lock "cinder-5b274cec-4cbb-4c9c-be8d-f2dd7a1c88a5-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:07:12 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Flow 'volume_create_manager' (13e01781-d79a-4d27-99c8-ac04bf0c1136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab1447b-2fff-4907-9b92-27630908c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab1447b-2fff-4907-9b92-27630908c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-331476206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c565e0fb-0c78-4ab5-b5d8-3e8e28942338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27d88dc99bf43c6b2726cabd7044090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:07:12Z,use_quota=True,user_id='c585a36a7ce44f6b99397cb54add5fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda90298-c84f-48a6-b76d-f20bbe08cd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda90298-c84f-48a6-b76d-f20bbe08cd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c68c5b-6a3d-4edd-92f7-8b4bb06f5db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c68c5b-6a3d-4edd-92f7-8b4bb06f5db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c565e0fb-0c78-4ab5-b5d8-3e8e28942338', 'volume_name': 'volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c20f0e-df9d-4345-8f04-a5f63170ab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c20f0e-df9d-4345-8f04-a5f63170ab4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f63afa-167f-4c98-a77e-672861cb4f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:07:12 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Volume c565e0fb-0c78-4ab5-b5d8-3e8e28942338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338', 'volume_size': 1} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-331476206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c565e0fb-0c78-4ab5-b5d8-3e8e28942338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27d88dc99bf43c6b2726cabd7044090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:07:12Z,use_quota=True,user_id='c585a36a7ce44f6b99397cb54add5fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Creating volume c565e0fb-0c78-4ab5-b5d8-3e8e28942338 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:07:12 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:12 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=141, name=volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338 1073741824" returned: 0 in 0.310s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338" returned: 0 in 0.079s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] <== create_volume: return (448ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.459s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f63afa-167f-4c98-a77e-672861cb4f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee7eb33-263a-45c4-8105-bad6b2e13d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:07:12 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Volume volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338 (c565e0fb-0c78-4ab5-b5d8-3e8e28942338): created successfully Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee7eb33-263a-45c4-8105-bad6b2e13d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:07:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Flow 'volume_create_manager' (13e01781-d79a-4d27-99c8-ac04bf0c1136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:07:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-9ff5987f-916c-4d8d-99b3-e7e30ff90f11 tempest-VolumesNegativeTest-1447767098 None] Created volume successfully. Sep 16 23:07:22 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:07:22 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=11,cinder:SELECT=9,cinder:INSERT=4,cinder:DELETE=2 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:07:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:07:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:07:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:07:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:07:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:07:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:07:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.094s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:07:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:07:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Acquiring lock "cinder-c565e0fb-0c78-4ab5-b5d8-3e8e28942338-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:07:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Lock "cinder-c565e0fb-0c78-4ab5-b5d8-3e8e28942338-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:07:49 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:07:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Acquiring lock "cinder-quobyte-c565e0fb-0c78-4ab5-b5d8-3e8e28942338" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:07:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Lock "cinder-quobyte-c565e0fb-0c78-4ab5-b5d8-3e8e28942338" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:07:50 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a546d-4a77-45ce-8c18-76b3061ac9a5]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:07:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338" returned: 0 in 0.374s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-c565e0fb-0c78-4ab5-b5d8-3e8e28942338" returned: 0 in 0.112s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:50 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Lock "cinder-quobyte-c565e0fb-0c78-4ab5-b5d8-3e8e28942338" released by "delete_volume" :: held 0.636s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:07:50 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Created reservations ['1c9b10d1-64b2-47dd-a26d-2c2c068932fe', 'fb4b38bc-7abd-4aff-acd1-ae2536538e50', '339f4290-164c-4112-a81e-db12a313e281', 'ef7b8127-441d-4b49-963c-0b2bdc79c2d4'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:07:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:07:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:07:51 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:07:51 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:07:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:07:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:07:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.108s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:07:51 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:07:51 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Deleted volume successfully. Sep 16 23:07:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e676b1dc-b70a-42c5-a2aa-d5795de80616 tempest-VolumesNegativeTest-1447767098 None] Lock "cinder-c565e0fb-0c78-4ab5-b5d8-3e8e28942338-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:08:01 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=6 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:08:01 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:08:13 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Flow 'volume_create_manager' (18bf35e5-f39b-42dd-bad5-815348165973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864ffc86-97d6-4594-9121-a7106f696eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864ffc86-97d6-4594-9121-a7106f696eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-652664054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3d9966-996e-43bb-a703-a539710bf529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d3f03987af41fc857d874c07be598f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:08:13Z,use_quota=True,user_id='b826153371f94d3f959eb7c487ac46b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de2463c0-510c-4c58-88e9-a23539144577),volume_type_id=de2463c0-510c-4c58-88e9-a23539144577)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc0af4e-180c-4a54-bb20-849231b919ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc0af4e-180c-4a54-bb20-849231b919ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e72afd1-d671-4c8a-a3df-433af8da078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e72afd1-d671-4c8a-a3df-433af8da078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3d9966-996e-43bb-a703-a539710bf529', 'volume_name': 'volume-9c3d9966-996e-43bb-a703-a539710bf529', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84a7526-e34e-4766-bd02-70e217dffe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84a7526-e34e-4766-bd02-70e217dffe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0ebf96-e12f-45d3-852e-93c4a94af294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:13 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume 9c3d9966-996e-43bb-a703-a539710bf529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3d9966-996e-43bb-a703-a539710bf529', 'volume_size': 1} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-652664054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3d9966-996e-43bb-a703-a539710bf529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d3f03987af41fc857d874c07be598f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:08:13Z,use_quota=True,user_id='b826153371f94d3f959eb7c487ac46b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de2463c0-510c-4c58-88e9-a23539144577),volume_type_id=de2463c0-510c-4c58-88e9-a23539144577)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Creating volume 9c3d9966-996e-43bb-a703-a539710bf529 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:08:13 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:08:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9c3d9966-996e-43bb-a703-a539710bf529 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:13 devstack quobyte-client[83246]: System call of process 98689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:08:13 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=142, name=volume-9c3d9966-996e-43bb-a703-a539710bf529, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:08:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Flow 'volume_create_manager' (16d740b6-ee56-4aab-80c4-309af906d029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8b0161-efc2-496f-aaa0-62bc3c39483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8b0161-efc2-496f-aaa0-62bc3c39483f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-937865835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdfc108-0898-480f-9a2a-3d1770866046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d3f03987af41fc857d874c07be598f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:08:13Z,use_quota=True,user_id='b826153371f94d3f959eb7c487ac46b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a052b7b4-09ea-4309-bb49-e5b194c2c06c),volume_type_id=a052b7b4-09ea-4309-bb49-e5b194c2c06c)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8a9780-f9a6-4b9e-ab87-428291b20d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8a9780-f9a6-4b9e-ab87-428291b20d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df76c8a7-d2f2-418a-bdb6-335df1a73313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df76c8a7-d2f2-418a-bdb6-335df1a73313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cdfc108-0898-480f-9a2a-3d1770866046', 'volume_name': 'volume-0cdfc108-0898-480f-9a2a-3d1770866046', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a236ea-ce87-4ba6-ad3f-4c9862740406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a236ea-ce87-4ba6-ad3f-4c9862740406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a75638f-9283-45e6-b385-a9b6dfe66e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:14 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume 0cdfc108-0898-480f-9a2a-3d1770866046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cdfc108-0898-480f-9a2a-3d1770866046', 'volume_size': 1} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9c3d9966-996e-43bb-a703-a539710bf529 1073741824" returned: 0 in 0.720s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9c3d9966-996e-43bb-a703-a539710bf529 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9c3d9966-996e-43bb-a703-a539710bf529" returned: 0 in 0.165s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] <== create_volume: return (924ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-937865835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdfc108-0898-480f-9a2a-3d1770866046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d3f03987af41fc857d874c07be598f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:08:13Z,use_quota=True,user_id='b826153371f94d3f959eb7c487ac46b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a052b7b4-09ea-4309-bb49-e5b194c2c06c),volume_type_id=a052b7b4-09ea-4309-bb49-e5b194c2c06c)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Creating volume 0cdfc108-0898-480f-9a2a-3d1770866046 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:08:14 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:08:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0cdfc108-0898-480f-9a2a-3d1770866046 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:14 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=143, name=volume-0cdfc108-0898-480f-9a2a-3d1770866046, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:08:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Flow 'volume_create_manager' (a15899cb-ff77-4531-b435-9beded056b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327b9efa-f79b-42e7-9779-34e0beb4c98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0ebf96-e12f-45d3-852e-93c4a94af294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3d9966-996e-43bb-a703-a539710bf529', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75653ab7-7dab-4208-90c2-64a5c780c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327b9efa-f79b-42e7-9779-34e0beb4c98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-855018262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ae097c-6647-4316-a620-dce73ef68c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d3f03987af41fc857d874c07be598f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:08:14Z,use_quota=True,user_id='b826153371f94d3f959eb7c487ac46b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d3a27c1-1489-4e86-99f8-dc30219608db),volume_type_id=4d3a27c1-1489-4e86-99f8-dc30219608db)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2691b3df-efdc-4985-8668-8b590691036b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2691b3df-efdc-4985-8668-8b590691036b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b6d2fb-0cdb-4fe9-88e9-ecc7355722b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0cdfc108-0898-480f-9a2a-3d1770866046 1073741824" returned: 0 in 0.689s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0cdfc108-0898-480f-9a2a-3d1770866046 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:15 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume volume-9c3d9966-996e-43bb-a703-a539710bf529 (9c3d9966-996e-43bb-a703-a539710bf529): created successfully Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75653ab7-7dab-4208-90c2-64a5c780c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Flow 'volume_create_manager' (18bf35e5-f39b-42dd-bad5-815348165973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0cdfc108-0898-480f-9a2a-3d1770866046" returned: 0 in 0.385s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] <== create_volume: return (1100ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:08:15 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-9ff720ee-8936-4099-8326-d78e4b588d4a tempest-TestInstancesWithCinderVolumes-1958664064 None] Created volume successfully. Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a75638f-9283-45e6-b385-a9b6dfe66e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cdfc108-0898-480f-9a2a-3d1770866046', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8618a897-aafa-4fcc-be67-745bfc11e28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b6d2fb-0cdb-4fe9-88e9-ecc7355722b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3ae097c-6647-4316-a620-dce73ef68c0f', 'volume_name': 'volume-f3ae097c-6647-4316-a620-dce73ef68c0f', 'volume_size': 1, 'image_id': '00302cdb-d39e-4275-99fd-462462bb2f76', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1671975535', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d3f03987af41fc857d874c07be598f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00302cdb-d39e-4275-99fd-462462bb2f76', 'created_at': datetime.datetime(2025, 9, 16, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 21, 8, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00302cdb-d39e-4275-99fd-462462bb2f76/file', 'properties': {}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697f11b0-71cf-4a7e-8ada-6d07a8c21822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697f11b0-71cf-4a7e-8ada-6d07a8c21822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c8fc2f-633c-4ecf-9f09-e4eae8968b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:15 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume f3ae097c-6647-4316-a620-dce73ef68c0f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3ae097c-6647-4316-a620-dce73ef68c0f', 'volume_size': 1, 'image_id': '00302cdb-d39e-4275-99fd-462462bb2f76', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1671975535', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d3f03987af41fc857d874c07be598f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00302cdb-d39e-4275-99fd-462462bb2f76', 'created_at': datetime.datetime(2025, 9, 16, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 21, 8, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00302cdb-d39e-4275-99fd-462462bb2f76/file', 'properties': {}}, 'image_service': } Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Cloning f3ae097c-6647-4316-a620-dce73ef68c0f from image 00302cdb-d39e-4275-99fd-462462bb2f76 at location (None, None). {{(pid=83223) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}} Sep 16 23:08:15 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume volume-0cdfc108-0898-480f-9a2a-3d1770866046 (0cdfc108-0898-480f-9a2a-3d1770866046): created successfully Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8618a897-aafa-4fcc-be67-745bfc11e28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Flow 'volume_create_manager' (16d740b6-ee56-4aab-80c4-309af906d029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:08:15 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a7ab05fe-9ec2-4b32-82c0-c07bef94ff8a tempest-TestInstancesWithCinderVolumes-1958664064 None] Created volume successfully. Sep 16 23:08:17 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD, size 20.69 MB, duration 1.26 sec {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 23:08:17 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Image download 20.69 MB at 16.38 MB/s Sep 16 23:08:17 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e679c2e-cdbc-4072-9452-99bd7058ccb9]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:08:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:17 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD Sep 16 23:08:17 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 23:08:19 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 16 23:08:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD" returned: 0 in 1.864s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:19 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Temporary image 00302cdb-d39e-4275-99fd-462462bb2f76 is fetched for user b826153371f94d3f959eb7c487ac46b7. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 23:08:19 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ffaaf9-d1f8-4556-9be7-dfcc71343c5c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:08:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:19 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD Sep 16 23:08:19 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 23:08:21 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD" returned: 0 in 2.228s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-855018262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ae097c-6647-4316-a620-dce73ef68c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45d3f03987af41fc857d874c07be598f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:08:14Z,use_quota=True,user_id='b826153371f94d3f959eb7c487ac46b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d3a27c1-1489-4e86-99f8-dc30219608db),volume_type_id=4d3a27c1-1489-4e86-99f8-dc30219608db)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Creating volume f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:08:21 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:08:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:21 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=144, name=volume-f3ae097c-6647-4316-a620-dce73ef68c0f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:08:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f 1073741824" returned: 0 in 0.288s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f" returned: 0 in 0.084s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:22 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] <== create_volume: return (464ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:08:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.501s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:08:22 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Attempting download of 00302cdb-d39e-4275-99fd-462462bb2f76 ((None, None)) to volume f3ae097c-6647-4316-a620-dce73ef68c0f. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 23:08:22 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[633222fe-723e-4345-b0e5-92aed96d2a55]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:08:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00302cdb-d39e-4275-99fd-462462bb2f76_6px2a3dy {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00302cdb-d39e-4275-99fd-462462bb2f76_6px2a3dy" returned: 0 in 0.346s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00302cdb-d39e-4275-99fd-462462bb2f76_6px2a3dy {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00302cdb-d39e-4275-99fd-462462bb2f76_6px2a3dy" returned: 1 in 0.334s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00302cdb-d39e-4275-99fd-462462bb2f76_6px2a3dy' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:08:23 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c13ed2e-67c0-4b0d-98b6-635e37133aaa]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:08:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:23 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] 00302cdb-d39e-4275-99fd-462462bb2f76 was qcow2, converting to raw {{(pid=83223) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 23:08:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:23 devstack quobyte-client[83246]: System call of process 98722 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:08:23 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=144, name=volume-f3ae097c-6647-4316-a620-dce73ef68c0f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:08:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f" returned: 0 in 0.826s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:24 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00302cdb-d39e-4275-99fd-462462bb2f76_6btx7_rcdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 23:08:24 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Converted 112.00 MB image at 112.00 MB/s Sep 16 23:08:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f 1G" returned: 0 in 0.164s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:24 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e71d485-50d0-4945-95f9-76441fb6e1cd]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:08:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f" returned: 0 in 0.333s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f" returned: 1 in 0.353s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:08:25 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Downloaded image 00302cdb-d39e-4275-99fd-462462bb2f76 ((None, None)) to volume f3ae097c-6647-4316-a620-dce73ef68c0f successfully. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 23:08:25 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Temporary image 00302cdb-d39e-4275-99fd-462462bb2f76 for user b826153371f94d3f959eb7c487ac46b7 is deleted. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 23:08:25 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Marking volume f3ae097c-6647-4316-a620-dce73ef68c0f as bootable. {{(pid=83223) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 23:08:25 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Copying metadata from image 00302cdb-d39e-4275-99fd-462462bb2f76 to f3ae097c-6647-4316-a620-dce73ef68c0f. {{(pid=83223) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 23:08:25 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Creating volume glance metadata for volume f3ae097c-6647-4316-a620-dce73ef68c0f backed by image 00302cdb-d39e-4275-99fd-462462bb2f76 with: {'image_id': '00302cdb-d39e-4275-99fd-462462bb2f76', 'image_name': 'tempest-scenario-img--1671975535', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83223) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 23:08:26 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c8fc2f-633c-4ecf-9f09-e4eae8968b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ae097c-6647-4316-a620-dce73ef68c0f', 'volume_size': 1, 'image_id': '00302cdb-d39e-4275-99fd-462462bb2f76', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1671975535', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d3f03987af41fc857d874c07be598f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '00302cdb-d39e-4275-99fd-462462bb2f76', 'created_at': datetime.datetime(2025, 9, 16, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 21, 8, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00302cdb-d39e-4275-99fd-462462bb2f76/file', 'properties': {}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:26 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1bc676-dbac-4ec7-9959-ae99818db067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:08:26 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume volume-f3ae097c-6647-4316-a620-dce73ef68c0f (f3ae097c-6647-4316-a620-dce73ef68c0f): created successfully Sep 16 23:08:26 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1bc676-dbac-4ec7-9959-ae99818db067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:08:26 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Flow 'volume_create_manager' (a15899cb-ff77-4531-b435-9beded056b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:08:26 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-11eefa2b-58fa-4a40-b0ae-e8d68a366eb3 tempest-TestInstancesWithCinderVolumes-1958664064 None] Created volume successfully. Sep 16 23:08:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:08:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:08:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:08:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:08:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:08:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:08:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.083s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:08:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:08:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:08:35 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[79624cc5-e5aa-4dca-9fac-5a9293803c3e]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:08:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f" returned: 0 in 0.457s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:08:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f" returned: 1 in 0.396s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:08:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:08:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:08:37 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-f3ae097c-6647-4316-a620-dce73ef68c0f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b940007-356c-404d-89b5-4fb931e4acba', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 23:08:37 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:08:37 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-f6f80b8d-f1f7-49bc-ae3d-5bce27f6a523 req-f9c90295-20af-4fef-8d88-595404638c86 tempest-TestInstancesWithCinderVolumes-1958664064 None] attachment_update completed successfully. Sep 16 23:08:47 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=5 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:08:47 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=9,cinder:SELECT=16,cinder:DELETE=1,cinder:INSERT=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:09:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:09:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:09:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:09:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:09:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:09:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:09:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:09:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.080s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:09:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:09:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:09:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-e7a37901-9693-47ff-a44e-7f268b04986e req-a823d7c9-b848-49e7-a21e-dc418e7eae46 tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:09:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-e7a37901-9693-47ff-a44e-7f268b04986e req-a823d7c9-b848-49e7-a21e-dc418e7eae46 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:09:46 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03a8395-8adb-47fe-8633-e5b81223cadc]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:09:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-e7a37901-9693-47ff-a44e-7f268b04986e req-a823d7c9-b848-49e7-a21e-dc418e7eae46 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9c3d9966-996e-43bb-a703-a539710bf529 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:09:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-e7a37901-9693-47ff-a44e-7f268b04986e req-a823d7c9-b848-49e7-a21e-dc418e7eae46 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9c3d9966-996e-43bb-a703-a539710bf529" returned: 0 in 0.893s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:09:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-e7a37901-9693-47ff-a44e-7f268b04986e req-a823d7c9-b848-49e7-a21e-dc418e7eae46 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.968s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:09:47 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-e7a37901-9693-47ff-a44e-7f268b04986e req-a823d7c9-b848-49e7-a21e-dc418e7eae46 tempest-TestInstancesWithCinderVolumes-1958664064 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-9c3d9966-996e-43bb-a703-a539710bf529', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd082dd2d-1039-438b-b7bc-2db43ca2fe05', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 23:09:47 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-e7a37901-9693-47ff-a44e-7f268b04986e req-a823d7c9-b848-49e7-a21e-dc418e7eae46 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:09:47 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-e7a37901-9693-47ff-a44e-7f268b04986e req-a823d7c9-b848-49e7-a21e-dc418e7eae46 tempest-TestInstancesWithCinderVolumes-1958664064 None] attachment_update completed successfully. Sep 16 23:09:57 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:09:57 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:09:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-3565dc98-19fc-4844-b2ca-f6ace87dc643 req-7ebbd504-7727-47a6-bb9e-26f2a975bb84 tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:09:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-3565dc98-19fc-4844-b2ca-f6ace87dc643 req-7ebbd504-7727-47a6-bb9e-26f2a975bb84 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:09:58 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1819893-c222-4509-b63e-35a9286583aa]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:09:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-3565dc98-19fc-4844-b2ca-f6ace87dc643 req-7ebbd504-7727-47a6-bb9e-26f2a975bb84 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0cdfc108-0898-480f-9a2a-3d1770866046 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:09:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-3565dc98-19fc-4844-b2ca-f6ace87dc643 req-7ebbd504-7727-47a6-bb9e-26f2a975bb84 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0cdfc108-0898-480f-9a2a-3d1770866046" returned: 0 in 0.377s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:09:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-3565dc98-19fc-4844-b2ca-f6ace87dc643 req-7ebbd504-7727-47a6-bb9e-26f2a975bb84 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.439s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:09:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-3565dc98-19fc-4844-b2ca-f6ace87dc643 req-7ebbd504-7727-47a6-bb9e-26f2a975bb84 tempest-TestInstancesWithCinderVolumes-1958664064 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-0cdfc108-0898-480f-9a2a-3d1770866046', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b98d80b-29f8-4a3b-a991-7cec5e1a4299', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 23:09:58 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-3565dc98-19fc-4844-b2ca-f6ace87dc643 req-7ebbd504-7727-47a6-bb9e-26f2a975bb84 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:09:58 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-3565dc98-19fc-4844-b2ca-f6ace87dc643 req-7ebbd504-7727-47a6-bb9e-26f2a975bb84 tempest-TestInstancesWithCinderVolumes-1958664064 None] attachment_update completed successfully. Sep 16 23:10:08 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=7 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:10:08 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:10:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:10:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:10:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:10:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:10:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:10:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:10:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:10:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.083s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:10:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:10:32 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-3fb89667-0a29-4c70-a07e-2f86679f6e6a req-fc166e48-400f-42de-8d2f-f74aa600fc5b tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:10:32 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-3fb89667-0a29-4c70-a07e-2f86679f6e6a req-fc166e48-400f-42de-8d2f-f74aa600fc5b tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:10:32 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-3fb89667-0a29-4c70-a07e-2f86679f6e6a req-fc166e48-400f-42de-8d2f-f74aa600fc5b tempest-TestInstancesWithCinderVolumes-1958664064 None] Terminate volume connection completed successfully. Sep 16 23:10:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-3fb89667-0a29-4c70-a07e-2f86679f6e6a req-fc166e48-400f-42de-8d2f-f74aa600fc5b tempest-TestInstancesWithCinderVolumes-1958664064 None] Deleting attachment d082dd2d-1039-438b-b7bc-2db43ca2fe05. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 23:10:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "cinder-9c3d9966-996e-43bb-a703-a539710bf529-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:10:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-9c3d9966-996e-43bb-a703-a539710bf529-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:10:33 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:10:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "cinder-quobyte-9c3d9966-996e-43bb-a703-a539710bf529" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:10:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-quobyte-9c3d9966-996e-43bb-a703-a539710bf529" acquired by "delete_volume" :: waited 0.011s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:10:33 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab88f15f-47cd-40f8-9096-47eb85167881]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:10:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9c3d9966-996e-43bb-a703-a539710bf529 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9c3d9966-996e-43bb-a703-a539710bf529" returned: 0 in 0.473s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9c3d9966-996e-43bb-a703-a539710bf529 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9c3d9966-996e-43bb-a703-a539710bf529" returned: 0 in 0.107s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-quobyte-9c3d9966-996e-43bb-a703-a539710bf529" released by "delete_volume" :: held 0.777s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:10:34 devstack cinder-volume[83223]: WARNING cinder.quota [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1688541717-1944305523 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1688541717-1944305523, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:10:34 devstack cinder-volume[83223]: WARNING cinder.quota [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1688541717-1944305523 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1688541717-1944305523, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Created reservations ['e86590ae-1cfe-4cec-93bd-34eba522df39', 'fcc33f51-825e-4c19-87f9-19d2b494f423', '847cb317-feb4-4a49-b913-1ff02f50de1f', '69fd7313-5fb4-40f5-9344-9f80cd0bcc61'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.090s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:10:34 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:10:35 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Deleted volume successfully. Sep 16 23:10:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9307b1f-d18d-4eb2-acd5-ef300fdc66b1 tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-9c3d9966-996e-43bb-a703-a539710bf529-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:10:44 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:10:45 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:11:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-f3693e09-c2a7-4bc5-ae67-3aaea7d66870 req-03708dd9-c72a-498b-a30a-d8f0808c8707 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:11:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-f3693e09-c2a7-4bc5-ae67-3aaea7d66870 req-03708dd9-c72a-498b-a30a-d8f0808c8707 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:11:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-f3693e09-c2a7-4bc5-ae67-3aaea7d66870 req-03708dd9-c72a-498b-a30a-d8f0808c8707 tempest-TestInstancesWithCinderVolumes-1958664064 None] Terminate volume connection completed successfully. Sep 16 23:11:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-f3693e09-c2a7-4bc5-ae67-3aaea7d66870 req-03708dd9-c72a-498b-a30a-d8f0808c8707 tempest-TestInstancesWithCinderVolumes-1958664064 None] Deleting attachment 0b98d80b-29f8-4a3b-a991-7cec5e1a4299. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 23:11:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "cinder-0cdfc108-0898-480f-9a2a-3d1770866046-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:11:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-0cdfc108-0898-480f-9a2a-3d1770866046-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:11:03 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:11:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "cinder-quobyte-0cdfc108-0898-480f-9a2a-3d1770866046" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:11:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-quobyte-0cdfc108-0898-480f-9a2a-3d1770866046" acquired by "delete_volume" :: waited 0.013s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:11:03 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0201069-8fa3-47ff-b752-9245ec90011c]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:11:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0cdfc108-0898-480f-9a2a-3d1770866046 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:11:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0cdfc108-0898-480f-9a2a-3d1770866046" returned: 0 in 0.538s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:11:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0cdfc108-0898-480f-9a2a-3d1770866046 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0cdfc108-0898-480f-9a2a-3d1770866046" returned: 0 in 0.092s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-quobyte-0cdfc108-0898-480f-9a2a-3d1770866046" released by "delete_volume" :: held 0.788s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:11:04 devstack cinder-volume[83223]: WARNING cinder.quota [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1913835233-599544781 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1913835233-599544781, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:11:04 devstack cinder-volume[83223]: WARNING cinder.quota [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1913835233-599544781 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1913835233-599544781, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Created reservations ['cb5186a5-76b1-4bb6-9eec-8a6533e5b7e4', 'b7d72a23-64b7-4f24-bf75-d87ee14c1a00', '4bbcf8b4-07d2-43cc-9275-451dac75b80f', '4d3ebc30-9832-4aa8-85c5-a54189cf0844'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.146s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:11:04 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:11:04 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Deleted volume successfully. Sep 16 23:11:05 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-874eca3d-590a-414b-bc14-5718a9848e1a tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-0cdfc108-0898-480f-9a2a-3d1770866046-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:11:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-a79e9a96-cffd-429f-95f7-190317fe0e46 req-dd2279fd-b28f-4bdf-b6bd-a774c82d1702 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:11:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-a79e9a96-cffd-429f-95f7-190317fe0e46 req-dd2279fd-b28f-4bdf-b6bd-a774c82d1702 tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:11:11 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-a79e9a96-cffd-429f-95f7-190317fe0e46 req-dd2279fd-b28f-4bdf-b6bd-a774c82d1702 tempest-TestInstancesWithCinderVolumes-1958664064 None] Terminate volume connection completed successfully. Sep 16 23:11:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-a79e9a96-cffd-429f-95f7-190317fe0e46 req-dd2279fd-b28f-4bdf-b6bd-a774c82d1702 tempest-TestInstancesWithCinderVolumes-1958664064 None] Deleting attachment 0b940007-356c-404d-89b5-4fb931e4acba. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 23:11:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "cinder-f3ae097c-6647-4316-a620-dce73ef68c0f-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:11:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-f3ae097c-6647-4316-a620-dce73ef68c0f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:11:15 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:11:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "cinder-quobyte-f3ae097c-6647-4316-a620-dce73ef68c0f" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:11:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-quobyte-f3ae097c-6647-4316-a620-dce73ef68c0f" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:11:15 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[69efe815-6410-47c3-a30b-9b93f3139db7]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:11:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:11:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f" returned: 0 in 0.363s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:11:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:11:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f" returned: 1 in 0.346s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:11:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:11:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:11:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-f3ae097c-6647-4316-a620-dce73ef68c0f" returned: 0 in 0.086s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:11:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-quobyte-f3ae097c-6647-4316-a620-dce73ef68c0f" released by "delete_volume" :: held 1.048s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:11:16 devstack cinder-volume[83223]: WARNING cinder.quota [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581303118-172719878 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581303118-172719878, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:11:16 devstack cinder-volume[83223]: WARNING cinder.quota [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581303118-172719878 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581303118-172719878, it is now deprecated. Please use the default quota class for default quota. Sep 16 23:11:17 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Created reservations ['78463d7d-0d4a-4ccd-b573-a74dc094cd8a', 'dd2dd79f-1c92-4ee1-97d0-6e85619a9cc2', 'b3a65d86-69e8-4f7a-bec5-7af18da3ec21', '084092dd-28a2-4149-b8ed-55cd8b9196df'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:11:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:11:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:11:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:11:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:11:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:11:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:11:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.078s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:11:17 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:11:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Deleted volume successfully. Sep 16 23:11:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-9012679e-1ab2-48ec-8a09-f66018e687aa tempest-TestInstancesWithCinderVolumes-1958664064 None] Lock "cinder-f3ae097c-6647-4316-a620-dce73ef68c0f-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:11:27 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:11:27 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=12,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:11:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:11:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:11:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:11:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:11:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:11:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:11:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:11:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.183s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:11:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:11:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:11:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:11:55 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:11:55 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:11:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Flow 'volume_create_manager' (c54322ec-8368-4476-ad9b-ae527c879864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:11:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f1b639-7f09-4e9c-a01a-51e800481ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:11:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f1b639-7f09-4e9c-a01a-51e800481ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1866600315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4cdc06-561e-44d7-b05e-0243915381cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc5c0616b8e46a495d78da54634c545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:11:56Z,use_quota=True,user_id='f9407368c1e94d1b94c4cbcb94ff3f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:11:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b3a188-b7b5-4a99-8ec0-b215acf7c3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:11:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b3a188-b7b5-4a99-8ec0-b215acf7c3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:11:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3358b2-1c10-4a5b-89ec-f5127d31811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:11:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3358b2-1c10-4a5b-89ec-f5127d31811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f4cdc06-561e-44d7-b05e-0243915381cc', 'volume_name': 'volume-7f4cdc06-561e-44d7-b05e-0243915381cc', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:11:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ea1a34-8e78-4438-8195-4dc0945ba3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:11:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ea1a34-8e78-4438-8195-4dc0945ba3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:11:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4f60dd-bb93-46f0-91af-b8ce700e52ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:11:56 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Volume 7f4cdc06-561e-44d7-b05e-0243915381cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f4cdc06-561e-44d7-b05e-0243915381cc', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 23:11:56 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Cloning 7f4cdc06-561e-44d7-b05e-0243915381cc from image 99ab3cef-3584-47a5-9dcc-19749e64ee70 at location (None, None). {{(pid=83223) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}} Sep 16 23:11:56 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 23:11:56 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Image download 20.69 MB at 20.69 MB/s Sep 16 23:11:56 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5413d781-792f-49e1-84ce-0cc55d1bff7f]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:11:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:11:57 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD Sep 16 23:11:57 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 23:11:58 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 16 23:11:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD" returned: 0 in 1.922s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:11:58 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Temporary image 99ab3cef-3584-47a5-9dcc-19749e64ee70 is fetched for user f9407368c1e94d1b94c4cbcb94ff3f7e. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 23:11:59 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fe8e39-6c56-48c3-a3db-4fa9dc9db5ff]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:11:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:11:59 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD Sep 16 23:11:59 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 23:12:00 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD" returned: 0 in 1.838s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1866600315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4cdc06-561e-44d7-b05e-0243915381cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc5c0616b8e46a495d78da54634c545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:11:56Z,use_quota=True,user_id='f9407368c1e94d1b94c4cbcb94ff3f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Creating volume 7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:12:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:12:00 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:12:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:01 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=145, name=volume-7f4cdc06-561e-44d7-b05e-0243915381cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:12:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc 1073741824" returned: 0 in 0.307s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 0 in 0.084s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] <== create_volume: return (472ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:12:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.503s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:12:01 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Attempting download of 99ab3cef-3584-47a5-9dcc-19749e64ee70 ((None, None)) to volume 7f4cdc06-561e-44d7-b05e-0243915381cc. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 23:12:01 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0471947-3134-4cf9-a634-a63a59c294b6]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:12:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_ooosiirz {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_ooosiirz" returned: 0 in 0.320s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_ooosiirz {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_ooosiirz" returned: 1 in 0.320s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99ab3cef-3584-47a5-9dcc-19749e64ee70_ooosiirz' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:12:02 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[54695013-166a-4a60-a3f0-fa287bd249e1]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:12:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:02 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] 99ab3cef-3584-47a5-9dcc-19749e64ee70 was qcow2, converting to raw {{(pid=83223) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 23:12:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:02 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=145, name=volume-7f4cdc06-561e-44d7-b05e-0243915381cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:12:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 0 in 0.950s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:03 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99ab3cef-3584-47a5-9dcc-19749e64ee70_duy31aq0devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 23:12:03 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Converted 112.00 MB image at 112.00 MB/s Sep 16 23:12:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc 1G" returned: 0 in 0.129s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:04 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce0eb42-ca2a-4244-a16e-38fd299600ee]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:12:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 0 in 0.363s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 1 in 0.355s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:12:04 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Downloaded image 99ab3cef-3584-47a5-9dcc-19749e64ee70 ((None, None)) to volume 7f4cdc06-561e-44d7-b05e-0243915381cc successfully. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 23:12:04 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Temporary image 99ab3cef-3584-47a5-9dcc-19749e64ee70 for user f9407368c1e94d1b94c4cbcb94ff3f7e is deleted. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 23:12:04 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Marking volume 7f4cdc06-561e-44d7-b05e-0243915381cc as bootable. {{(pid=83223) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 23:12:05 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Copying metadata from image 99ab3cef-3584-47a5-9dcc-19749e64ee70 to 7f4cdc06-561e-44d7-b05e-0243915381cc. {{(pid=83223) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 23:12:05 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Creating volume glance metadata for volume 7f4cdc06-561e-44d7-b05e-0243915381cc backed by image 99ab3cef-3584-47a5-9dcc-19749e64ee70 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83223) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 23:12:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4f60dd-bb93-46f0-91af-b8ce700e52ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4cdc06-561e-44d7-b05e-0243915381cc', 'volume_size': 1, 'image_id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5c03f2fc5ad499e9124a74aa7f2f389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '99ab3cef-3584-47a5-9dcc-19749e64ee70', 'created_at': datetime.datetime(2025, 9, 16, 20, 19, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 20, 19, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99ab3cef-3584-47a5-9dcc-19749e64ee70/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:12:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4f1392-15cb-4b8f-88af-aaa6cc0ee645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:12:05 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Volume volume-7f4cdc06-561e-44d7-b05e-0243915381cc (7f4cdc06-561e-44d7-b05e-0243915381cc): created successfully Sep 16 23:12:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4f1392-15cb-4b8f-88af-aaa6cc0ee645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:12:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Flow 'volume_create_manager' (c54322ec-8368-4476-ad9b-ae527c879864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:12:05 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0e92faa6-a907-4ed7-b22f-51a7b8f6ba32 tempest-TestShelveInstance-1464093742 None] Created volume successfully. Sep 16 23:12:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:12:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:12:13 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a363bb-ecd6-4a43-825d-f1a951920a89]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:12:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 0 in 0.392s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 1 in 0.393s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:12:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.918s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:12:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-7f4cdc06-561e-44d7-b05e-0243915381cc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a316c7d-dc9f-4313-b816-bc332cfd8b7c', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 23:12:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:12:14 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-0eb879ee-93d9-4a65-9c8a-7a630f52f265 req-518377fb-632f-4c18-a1c3-9e5a11f09047 tempest-TestShelveInstance-1464093742 None] attachment_update completed successfully. Sep 16 23:12:24 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=20,cinder:UPDATE=4,cinder:INSERT=4 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:12:24 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=6,cinder:INSERT=9,cinder:SELECT=8,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:12:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:12:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:12:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:12:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:12:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:12:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:12:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:12:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.250s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:12:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:13:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:13:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:13:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:13:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:13:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:13:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:13:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:13:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.078s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:13:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:13:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:13:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:13:44 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-722a774e-fc98-4689-be95-8883ab54b1f1 req-34624d03-b707-478e-a925-96bb391cb265 tempest-TestShelveInstance-1464093742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:13:44 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-722a774e-fc98-4689-be95-8883ab54b1f1 req-34624d03-b707-478e-a925-96bb391cb265 tempest-TestShelveInstance-1464093742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:13:44 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-722a774e-fc98-4689-be95-8883ab54b1f1 req-34624d03-b707-478e-a925-96bb391cb265 tempest-TestShelveInstance-1464093742 None] Terminate volume connection completed successfully. Sep 16 23:13:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-722a774e-fc98-4689-be95-8883ab54b1f1 req-34624d03-b707-478e-a925-96bb391cb265 tempest-TestShelveInstance-1464093742 None] Deleting attachment 6a316c7d-dc9f-4313-b816-bc332cfd8b7c. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 23:13:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:13:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:13:51 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a13e727-4356-4dda-af9c-5efabd1a0650]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:13:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:13:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 0 in 0.364s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:13:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:13:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 1 in 0.340s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:13:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:13:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.872s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:13:52 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d', 'name': 'volume-7f4cdc06-561e-44d7-b05e-0243915381cc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc281f2b-1439-4e83-8d08-5baf17bc1ac4', 'enforce_multipath': True} {{(pid=83223) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 23:13:52 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:13:52 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-93015159-64a6-4784-9528-4317a39e5a1f req-822b3508-ae0b-461f-bec6-51387acb05a7 tempest-TestShelveInstance-1464093742 None] attachment_update completed successfully. Sep 16 23:14:02 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:14:02 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:14:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:14:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:14:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:14:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:14:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:14:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:14:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:14:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.126s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:14:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:15:22 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-d48b86ac-5b34-40b0-bb48-774d0e013d62 tempest-TestShelveInstance-1464093742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:15:22 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-d48b86ac-5b34-40b0-bb48-774d0e013d62 tempest-TestShelveInstance-1464093742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:15:22 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-d48b86ac-5b34-40b0-bb48-774d0e013d62 tempest-TestShelveInstance-1464093742 None] Terminate volume connection completed successfully. Sep 16 23:15:22 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-d48b86ac-5b34-40b0-bb48-774d0e013d62 tempest-TestShelveInstance-1464093742 None] Deleting attachment bc281f2b-1439-4e83-8d08-5baf17bc1ac4. {{(pid=83223) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 23:15:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Acquiring lock "cinder-7f4cdc06-561e-44d7-b05e-0243915381cc-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:15:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Lock "cinder-7f4cdc06-561e-44d7-b05e-0243915381cc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:15:23 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:15:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Acquiring lock "cinder-quobyte-7f4cdc06-561e-44d7-b05e-0243915381cc" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:15:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Lock "cinder-quobyte-7f4cdc06-561e-44d7-b05e-0243915381cc" acquired by "delete_volume" :: waited 0.010s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:15:23 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69c4d10-4643-4452-b439-f89fbed7c039]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:15:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 0 in 0.373s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:15:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 1 in 0.357s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7f4cdc06-561e-44d7-b05e-0243915381cc" returned: 0 in 0.078s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Lock "cinder-quobyte-7f4cdc06-561e-44d7-b05e-0243915381cc" released by "delete_volume" :: held 1.108s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG cinder.quota [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Created reservations ['2f3f3895-64d4-4617-a9f1-801ba826c158', '1aaa2573-7d6f-4943-88f2-8348c3dde6be', '9ade979b-53ed-497c-a01f-79c89ac77445', 'de226fbe-0dbf-494f-859d-5c6ec9caa600'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.101s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:15:24 devstack cinder-volume[83223]: DEBUG cinder.manager [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:15:24 devstack cinder-volume[83223]: INFO cinder.volume.manager [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Deleted volume successfully. Sep 16 23:15:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [req-b30494a0-ca64-4ba7-8ae5-1474663c3c28 req-cbdb977e-3234-4723-995e-c36fb7d4db32 tempest-TestShelveInstance-1464093742 None] Lock "cinder-7f4cdc06-561e-44d7-b05e-0243915381cc-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:15:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:15:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:15:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:15:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:15:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:15:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.099s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:15:28 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:15:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:15:41 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:15:55 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Flow 'volume_create_manager' (21365188-aacb-4893-b44c-089d44f6c42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6481aa4f-b13c-4d01-b8fa-b5967445ba02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:55 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Flow 'volume_create_manager' (2ab14a40-3959-48ec-af86-fb5baa81b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae334dcf-71c0-4bd3-aa0d-3e57d9046e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6481aa4f-b13c-4d01-b8fa-b5967445ba02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732984899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd09deeb-50d2-46e9-8c13-70854e7196fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adba2d743d74aacbb87aaed9c3b4ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:56Z,use_quota=True,user_id='a16e2ae5e3614dac848767ff9d04e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a517646-df1f-4c82-869e-1ba53089b9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a517646-df1f-4c82-869e-1ba53089b9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1dc451-cdcc-466b-8fb0-e1a39143442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e1dc451-cdcc-466b-8fb0-e1a39143442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd09deeb-50d2-46e9-8c13-70854e7196fd', 'volume_name': 'volume-bd09deeb-50d2-46e9-8c13-70854e7196fd', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4167c1ae-f6c4-4505-a092-cc2ee9f26bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4167c1ae-f6c4-4505-a092-cc2ee9f26bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9708f82-5694-4291-9700-53fd272873c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:55 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Volume bd09deeb-50d2-46e9-8c13-70854e7196fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd09deeb-50d2-46e9-8c13-70854e7196fd', 'volume_size': 1} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732984899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd09deeb-50d2-46e9-8c13-70854e7196fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adba2d743d74aacbb87aaed9c3b4ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:56Z,use_quota=True,user_id='a16e2ae5e3614dac848767ff9d04e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Creating volume bd09deeb-50d2-46e9-8c13-70854e7196fd {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:15:55 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:15:55 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bd09deeb-50d2-46e9-8c13-70854e7196fd 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:56 devstack quobyte-client[83246]: System call of process 101134 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:15:56 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=146, name=volume-bd09deeb-50d2-46e9-8c13-70854e7196fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae334dcf-71c0-4bd3-aa0d-3e57d9046e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bcedda-2ac2-4705-ae62-5c9f0d045faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96dc453c59b4594949b267d769d4bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:55Z,use_quota=True,user_id='46236a36fb9a4f8f8a999c59b07f8b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4df70d-c23f-4030-8e7f-03f472dc5486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4df70d-c23f-4030-8e7f-03f472dc5486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46074685-6a8b-4365-ab53-fd747401a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46074685-6a8b-4365-ab53-fd747401a04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bcedda-2ac2-4705-ae62-5c9f0d045faf', 'volume_name': 'volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db17bf2-ff94-4418-a76d-ee2c78db0e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db17bf2-ff94-4418-a76d-ee2c78db0e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa9daf4-d48e-41c9-8315-0b790fa5aaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:56 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Volume 63bcedda-2ac2-4705-ae62-5c9f0d045faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf', 'volume_size': 1} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:56 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Flow 'volume_create_manager' (9e9b23a6-0e33-4f13-914c-8f094e36a769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3140eef-f12d-48ed-a263-bdbfee099550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bd09deeb-50d2-46e9-8c13-70854e7196fd 1073741824" returned: 0 in 0.978s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:15:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bd09deeb-50d2-46e9-8c13-70854e7196fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3140eef-f12d-48ed-a263-bdbfee099550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-296634008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e96ff1-1e7a-4a63-b2d3-6265a92858bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adba2d743d74aacbb87aaed9c3b4ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:56Z,use_quota=True,user_id='a16e2ae5e3614dac848767ff9d04e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8ac2ac-1bcc-4d4d-a793-631491581788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8ac2ac-1bcc-4d4d-a793-631491581788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7347b3-00d0-47b8-bf4c-7a3bd98ead89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7347b3-00d0-47b8-bf4c-7a3bd98ead89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e96ff1-1e7a-4a63-b2d3-6265a92858bb', 'volume_name': 'volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a92128-e319-4ec8-ac0c-f2840da65c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a92128-e319-4ec8-ac0c-f2840da65c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7018a131-06f8-4340-b28c-2d9b3a455071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:57 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Volume 96e96ff1-1e7a-4a63-b2d3-6265a92858bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb', 'volume_size': 1} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bd09deeb-50d2-46e9-8c13-70854e7196fd" returned: 0 in 0.638s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:15:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Flow 'volume_create_manager' (ca368b5a-f373-4404-b6e5-ba99edd763a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a06eb83-94d0-47e6-bf35-62e4c55bcf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] <== create_volume: return (1751ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:15:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Flow 'volume_create_manager' (27a855ef-f60c-46c8-9cd2-67b312884bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3faa33d2-6d0f-435b-9274-70b14809492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.166s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bcedda-2ac2-4705-ae62-5c9f0d045faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96dc453c59b4594949b267d769d4bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:55Z,use_quota=True,user_id='46236a36fb9a4f8f8a999c59b07f8b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Creating volume 63bcedda-2ac2-4705-ae62-5c9f0d045faf {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:15:57 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:57 devstack quobyte-client[83246]: System call of process 101138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:15:57 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9708f82-5694-4291-9700-53fd272873c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd09deeb-50d2-46e9-8c13-70854e7196fd', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:57 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=147, name=volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b73d02-5401-4bea-bbe4-2c70d3d76ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Volume volume-bd09deeb-50d2-46e9-8c13-70854e7196fd (bd09deeb-50d2-46e9-8c13-70854e7196fd): created successfully Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b73d02-5401-4bea-bbe4-2c70d3d76ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Flow 'volume_create_manager' (21365188-aacb-4893-b44c-089d44f6c42c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:15:58 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Flow 'volume_create_manager' (4788fa40-4492-46e6-b596-c09d20feef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd9374a-2310-4916-ae1c-209f2f2a9b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3faa33d2-6d0f-435b-9274-70b14809492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897553330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b36f72-16d9-4e16-847b-ec68d496a0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adba2d743d74aacbb87aaed9c3b4ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:57Z,use_quota=True,user_id='a16e2ae5e3614dac848767ff9d04e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5546d863-fe26-47cb-b354-fbd5f87985bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5546d863-fe26-47cb-b354-fbd5f87985bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5972161-6ee7-4d1b-90fc-6a39f098b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5972161-6ee7-4d1b-90fc-6a39f098b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b36f72-16d9-4e16-847b-ec68d496a0e3', 'volume_name': 'volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf98d3da-73f8-4cfe-8ff2-80ba6e1fcdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf98d3da-73f8-4cfe-8ff2-80ba6e1fcdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e5c190-ea7c-4369-9afa-77f793384ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Volume b0b36f72-16d9-4e16-847b-ec68d496a0e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3', 'volume_size': 1} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a06eb83-94d0-47e6-bf35-62e4c55bcf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-770419520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41fbb234-d52a-4730-8a20-b63a4592e920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adba2d743d74aacbb87aaed9c3b4ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:57Z,use_quota=True,user_id='a16e2ae5e3614dac848767ff9d04e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb92d492-bfdc-473c-b539-87fb2032d822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb92d492-bfdc-473c-b539-87fb2032d822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7565e0b5-8642-42d2-91c7-eacfcd43531b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7565e0b5-8642-42d2-91c7-eacfcd43531b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41fbb234-d52a-4730-8a20-b63a4592e920', 'volume_name': 'volume-41fbb234-d52a-4730-8a20-b63a4592e920', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964d1e83-b1dc-4697-818a-085e339eb541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964d1e83-b1dc-4697-818a-085e339eb541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a833ccd3-69a3-4e69-9632-5cf0e599a4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Volume 41fbb234-d52a-4730-8a20-b63a4592e920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41fbb234-d52a-4730-8a20-b63a4592e920', 'volume_size': 1} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd9374a-2310-4916-ae1c-209f2f2a9b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-67819566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e91d28-5e5a-4f37-af35-c61d705d6089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adba2d743d74aacbb87aaed9c3b4ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:58Z,use_quota=True,user_id='a16e2ae5e3614dac848767ff9d04e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a754da3e-f78d-4c54-9052-a885abfe1299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a754da3e-f78d-4c54-9052-a885abfe1299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02da5d05-6649-4f3b-86c2-08be60645575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02da5d05-6649-4f3b-86c2-08be60645575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e91d28-5e5a-4f37-af35-c61d705d6089', 'volume_name': 'volume-44e91d28-5e5a-4f37-af35-c61d705d6089', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844a4924-38ba-4227-8b23-cd386fa3b028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844a4924-38ba-4227-8b23-cd386fa3b028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56e230c-ff57-47ab-a92b-830b30ab1041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:58 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Volume 44e91d28-5e5a-4f37-af35-c61d705d6089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e91d28-5e5a-4f37-af35-c61d705d6089', 'volume_size': 1} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf 1073741824" returned: 0 in 0.725s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:58 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e7c32835-476e-44b2-9114-92c73ca336cc tempest-CreateVolumesFromImageTest-1406804545 None] Created volume successfully. Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf" returned: 0 in 0.441s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] <== create_volume: return (1203ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:15:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-296634008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e96ff1-1e7a-4a63-b2d3-6265a92858bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adba2d743d74aacbb87aaed9c3b4ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:56Z,use_quota=True,user_id='a16e2ae5e3614dac848767ff9d04e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Creating volume 96e96ff1-1e7a-4a63-b2d3-6265a92858bb {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:15:59 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:59 devstack quobyte-client[83246]: System call of process 101142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:15:59 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=148, name=volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:15:59 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Flow 'volume_create_manager' (a9704459-b8e1-4ad8-8dfa-9018a1d647a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4c98e7-7769-4046-9d81-f72333716125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4c98e7-7769-4046-9d81-f72333716125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf26b21-8437-47bd-82c9-1858a1a7c5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca014f5519e84945976f69ade3a7a305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:59Z,use_quota=True,user_id='b57cf3a067e9435baf47db117e66bc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdbd1f6-8de2-4a67-a227-b770a3a5c67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdbd1f6-8de2-4a67-a227-b770a3a5c67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe06c205-b4d8-4785-b954-ea2a4c00726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa9daf4-d48e-41c9-8315-0b790fa5aaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394e9bb5-7fca-43bf-86fd-75cdfdae111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb 1073741824" returned: 0 in 0.592s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:15:59 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Volume volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf (63bcedda-2ac2-4705-ae62-5c9f0d045faf): created successfully Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394e9bb5-7fca-43bf-86fd-75cdfdae111d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:15:59 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Flow 'volume_create_manager' (2ab14a40-3959-48ec-af86-fb5baa81b60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb" returned: 0 in 0.510s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] <== create_volume: return (1123ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897553330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b36f72-16d9-4e16-847b-ec68d496a0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adba2d743d74aacbb87aaed9c3b4ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:57Z,use_quota=True,user_id='a16e2ae5e3614dac848767ff9d04e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Creating volume b0b36f72-16d9-4e16-847b-ec68d496a0e3 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:00 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:00 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=149, name=volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:00 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d0a2c589-8a8c-4a26-a664-a44eba918ca1 tempest-CinderUnicodeTest-1651822757 None] Created volume successfully. Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7018a131-06f8-4340-b28c-2d9b3a455071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dee74d-6102-4536-a043-c3d4267cde1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3 1073741824" returned: 0 in 0.650s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe06c205-b4d8-4785-b954-ea2a4c00726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bcf26b21-8437-47bd-82c9-1858a1a7c5d7', 'volume_name': 'volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7', 'volume_size': 1, 'image_id': '8d455306-4dab-4903-8b5a-c8226b72c5d9', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a945b3d25ee5d78d9c04a6509f906fe4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca014f5519e84945976f69ade3a7a305', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '67f772e08b8acf68a30765f079c62d3b3252f4fe978e4e7b0bbd2759fafd327d8aa9ca9c24bca4cf13f407995e1603493796fb38ec0c060b7de0815a2d6baaab', 'id': '8d455306-4dab-4903-8b5a-c8226b72c5d9', 'created_at': datetime.datetime(2025, 9, 16, 21, 15, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 21, 15, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d455306-4dab-4903-8b5a-c8226b72c5d9/file', 'properties': {}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80a1e3c-781d-4243-9236-4e1a2ee6f84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80a1e3c-781d-4243-9236-4e1a2ee6f84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc43f66-74b5-4de1-9f3e-2d1d1b62d78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:01 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Volume bcf26b21-8437-47bd-82c9-1858a1a7c5d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7', 'volume_size': 1, 'image_id': '8d455306-4dab-4903-8b5a-c8226b72c5d9', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a945b3d25ee5d78d9c04a6509f906fe4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca014f5519e84945976f69ade3a7a305', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '67f772e08b8acf68a30765f079c62d3b3252f4fe978e4e7b0bbd2759fafd327d8aa9ca9c24bca4cf13f407995e1603493796fb38ec0c060b7de0815a2d6baaab', 'id': '8d455306-4dab-4903-8b5a-c8226b72c5d9', 'created_at': datetime.datetime(2025, 9, 16, 21, 15, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 21, 15, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d455306-4dab-4903-8b5a-c8226b72c5d9/file', 'properties': {}}, 'image_service': } Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Cloning bcf26b21-8437-47bd-82c9-1858a1a7c5d7 from image 8d455306-4dab-4903-8b5a-c8226b72c5d9 at location (None, None). {{(pid=83223) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1081}} Sep 16 23:16:01 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Volume volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb (96e96ff1-1e7a-4a63-b2d3-6265a92858bb): created successfully Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dee74d-6102-4536-a043-c3d4267cde1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Flow 'volume_create_manager' (9e9b23a6-0e33-4f13-914c-8f094e36a769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:01 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Flow 'volume_create_manager' (54885649-44b2-41dc-a1e5-056182ce6a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7328a46-ae19-463f-ac2a-040e0bbad399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3" returned: 0 in 0.580s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-72f9bc3e-3e96-4cb4-b73a-381b5b025f9f tempest-CreateVolumesFromImageTest-1406804545 None] Created volume successfully. Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] <== create_volume: return (1269ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.988s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-770419520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41fbb234-d52a-4730-8a20-b63a4592e920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adba2d743d74aacbb87aaed9c3b4ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:57Z,use_quota=True,user_id='a16e2ae5e3614dac848767ff9d04e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Creating volume 41fbb234-d52a-4730-8a20-b63a4592e920 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:01 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-41fbb234-d52a-4730-8a20-b63a4592e920 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:01 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=150, name=volume-41fbb234-d52a-4730-8a20-b63a4592e920, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 23:16:01 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Image download 0.00 MB at 0.00 MB/s Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7328a46-ae19-463f-ac2a-040e0bbad399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1513710083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3852853b-fde6-43ef-a3e5-8c34920fc26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96dc453c59b4594949b267d769d4bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:00Z,use_quota=True,user_id='46236a36fb9a4f8f8a999c59b07f8b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c265519-494b-4c89-8296-c3366b5403dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c265519-494b-4c89-8296-c3366b5403dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769a10fa-6dec-4989-b592-b9aa4cff3da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769a10fa-6dec-4989-b592-b9aa4cff3da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3852853b-fde6-43ef-a3e5-8c34920fc26b', 'volume_name': 'volume-3852853b-fde6-43ef-a3e5-8c34920fc26b', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8ab399-d146-4d66-8976-8ba5762d6163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8ab399-d146-4d66-8976-8ba5762d6163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0963a878-27e7-4582-af98-80a8a64c39ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:01 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Volume 3852853b-fde6-43ef-a3e5-8c34920fc26b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3852853b-fde6-43ef-a3e5-8c34920fc26b', 'volume_size': 1} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e5c190-ea7c-4369-9afa-77f793384ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:01 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b08037a-59ca-490b-81ff-460dfa95631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-41fbb234-d52a-4730-8a20-b63a4592e920 1073741824" returned: 0 in 0.542s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-41fbb234-d52a-4730-8a20-b63a4592e920 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:02 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Volume volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3 (b0b36f72-16d9-4e16-847b-ec68d496a0e3): created successfully Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b08037a-59ca-490b-81ff-460dfa95631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Flow 'volume_create_manager' (27a855ef-f60c-46c8-9cd2-67b312884bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-41fbb234-d52a-4730-8a20-b63a4592e920" returned: 0 in 0.409s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] <== create_volume: return (974ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6126b9-3aae-4a68-8540-a09bfc30ff28]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.956s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-67819566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e91d28-5e5a-4f37-af35-c61d705d6089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adba2d743d74aacbb87aaed9c3b4ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:58Z,use_quota=True,user_id='a16e2ae5e3614dac848767ff9d04e605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Creating volume 44e91d28-5e5a-4f37-af35-c61d705d6089 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:02 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-44e91d28-5e5a-4f37-af35-c61d705d6089 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:02 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=151, name=volume-44e91d28-5e5a-4f37-af35-c61d705d6089, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:02 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-88633fb6-77d0-4527-8964-d4471a9d11fd tempest-CreateVolumesFromImageTest-1406804545 None] Created volume successfully. Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a833ccd3-69a3-4e69-9632-5cf0e599a4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41fbb234-d52a-4730-8a20-b63a4592e920', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd260133-de88-424c-97cd-59a46592aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-44e91d28-5e5a-4f37-af35-c61d705d6089 1073741824" returned: 0 in 0.576s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-44e91d28-5e5a-4f37-af35-c61d705d6089 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:03 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD Sep 16 23:16:03 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 23:16:03 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Volume volume-41fbb234-d52a-4730-8a20-b63a4592e920 (41fbb234-d52a-4730-8a20-b63a4592e920): created successfully Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd260133-de88-424c-97cd-59a46592aebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Flow 'volume_create_manager' (ca368b5a-f373-4404-b6e5-ba99edd763a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-44e91d28-5e5a-4f37-af35-c61d705d6089" returned: 0 in 0.381s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] <== create_volume: return (982ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.568s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1513710083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3852853b-fde6-43ef-a3e5-8c34920fc26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96dc453c59b4594949b267d769d4bb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:00Z,use_quota=True,user_id='46236a36fb9a4f8f8a999c59b07f8b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Creating volume 3852853b-fde6-43ef-a3e5-8c34920fc26b {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:03 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:03 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=152, name=volume-3852853b-fde6-43ef-a3e5-8c34920fc26b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56e230c-ff57-47ab-a92b-830b30ab1041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e91d28-5e5a-4f37-af35-c61d705d6089', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8118214b-6f33-4e47-ab52-ef4cdc7d5ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:03 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-9a994d9e-5283-44a5-b755-89f8437f30c8 tempest-CreateVolumesFromImageTest-1406804545 None] Created volume successfully. Sep 16 23:16:03 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Volume volume-44e91d28-5e5a-4f37-af35-c61d705d6089 (44e91d28-5e5a-4f37-af35-c61d705d6089): created successfully Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8118214b-6f33-4e47-ab52-ef4cdc7d5ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:03 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Flow 'volume_create_manager' (4788fa40-4492-46e6-b596-c09d20feef3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b 1073741824" returned: 0 in 0.531s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:04 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-765a7510-bd5c-4951-93f7-56e35ca92984 tempest-CreateVolumesFromImageTest-1406804545 None] Created volume successfully. Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b" returned: 0 in 0.312s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] <== create_volume: return (897ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0963a878-27e7-4582-af98-80a8a64c39ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3852853b-fde6-43ef-a3e5-8c34920fc26b', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fad01ca-fedd-4d84-950b-4d7b15c8bef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:04 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Volume volume-3852853b-fde6-43ef-a3e5-8c34920fc26b (3852853b-fde6-43ef-a3e5-8c34920fc26b): created successfully Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fad01ca-fedd-4d84-950b-4d7b15c8bef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Flow 'volume_create_manager' (54885649-44b2-41dc-a1e5-056182ce6a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:04 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a149bbf9-1835-4254-8ab1-ba8f1d16d6ab tempest-CinderUnicodeTest-1651822757 None] Created volume successfully. Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "cinder-44e91d28-5e5a-4f37-af35-c61d705d6089-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-44e91d28-5e5a-4f37-af35-c61d705d6089-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:04 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "cinder-quobyte-44e91d28-5e5a-4f37-af35-c61d705d6089" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-quobyte-44e91d28-5e5a-4f37-af35-c61d705d6089" acquired by "delete_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:05 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8930c-438a-45d0-be43-e37e96705690]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-44e91d28-5e5a-4f37-af35-c61d705d6089 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:05 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 16 23:16:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD" returned: 0 in 3.298s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:06 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Creating offline snapshot c7d912f5-2215-441c-bd9a-acc3a7597c51 of volume 3852853b-fde6-43ef-a3e5-8c34920fc26b {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 23:16:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-44e91d28-5e5a-4f37-af35-c61d705d6089" returned: 0 in 1.235s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-44e91d28-5e5a-4f37-af35-c61d705d6089 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:06 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[62821d5a-f6e5-4783-8c2a-2e9d9032869e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:06 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD Sep 16 23:16:06 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 23:16:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-44e91d28-5e5a-4f37-af35-c61d705d6089" returned: 0 in 0.334s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:06 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-quobyte-44e91d28-5e5a-4f37-af35-c61d705d6089" released by "delete_volume" :: held 1.788s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Created reservations ['9e772506-f485-413c-8d47-44353f486b4c', 'b1b9aaef-0b36-43fb-be58-81c4e469946b', '5055eafa-1cbc-4097-9e41-10451ee67d50', 'ec98a2d2-4939-45eb-9477-518a030e792a'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b" returned: 0 in 0.805s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:07 devstack quobyte-client[83246]: System call of process 101176 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:16:07 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=153, name=volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.034s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51 1G" returned: 0 in 0.438s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3852853b-fde6-43ef-a3e5-8c34920fc26b -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.237s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:07 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] CMD "qemu-img rebase -u -b volume-3852853b-fde6-43ef-a3e5-8c34920fc26b -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51" returned: 0 in 0.257s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:08 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Deleted volume successfully. Sep 16 23:16:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:16:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "cinder-b0b36f72-16d9-4e16-847b-ec68d496a0e3-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51" returned: 0 in 0.663s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:08 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5ef7c4c1-3eed-45fc-9ebb-a698a11e2abc tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-44e91d28-5e5a-4f37-af35-c61d705d6089-delete_volume" released by "delete_volume" :: held 4.078s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:08 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 16 23:16:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 23:16:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-b0b36f72-16d9-4e16-847b-ec68d496a0e3-delete_volume" acquired by "delete_volume" :: waited 0.348s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD" returned: 1 in 3.322s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:16:09 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Temporary image 8d455306-4dab-4903-8b5a-c8226b72c5d9 is fetched for user b57cf3a067e9435baf47db117e66bc5c. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 23:16:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51" returned: 0 in 0.418s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.info" returned: 0 in 0.408s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:16:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:09 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:09 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "cinder-quobyte-b0b36f72-16d9-4e16-847b-ec68d496a0e3" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.info" returned: 0 in 0.367s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.064s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:10 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-quobyte-b0b36f72-16d9-4e16-847b-ec68d496a0e3" acquired by "delete_volume" :: waited 0.262s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:10 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b5764f-2f17-4a88-98d5-659857efced4]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:10 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96718af-a5ee-4903-b6fd-e14d3ab42eef]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:10 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-030e2d00-22ef-41be-a800-4e6975f48363 tempest-CinderUnicodeTest-1651822757 None] Create snapshot completed successfully Sep 16 23:16:10 devstack quobyte-client[83246]: System call of process 101190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:16:10 devstack quobyte-client[83246]: System call of process 101190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:16:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3" returned: 0 in 0.637s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:11 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD Sep 16 23:16:11 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "cinder-c7d912f5-2215-441c-bd9a-acc3a7597c51-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b0b36f72-16d9-4e16-847b-ec68d496a0e3" returned: 0 in 0.395s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-c7d912f5-2215-441c-bd9a-acc3a7597c51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.133s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "cinder-quobyte-3852853b-fde6-43ef-a3e5-8c34920fc26b" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-quobyte-b0b36f72-16d9-4e16-847b-ec68d496a0e3" released by "delete_volume" :: held 1.164s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-quobyte-3852853b-fde6-43ef-a3e5-8c34920fc26b" acquired by "delete_snapshot" :: waited 0.145s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "cinder-quobyte-c7d912f5-2215-441c-bd9a-acc3a7597c51" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-quobyte-c7d912f5-2215-441c-bd9a-acc3a7597c51" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Deleting offline snapshot c7d912f5-2215-441c-bd9a-acc3a7597c51 of volume 3852853b-fde6-43ef-a3e5-8c34920fc26b {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] snapshot_file for this snap is: volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e07c831-c900-496e-a604-c872feb362a5]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:11 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Created reservations ['156338d3-19ce-4050-a7c4-a8e1a261d184', '270dec23-a058-4f11-9a85-666ace7a1ff1', 'df864e78-3f3c-4d53-a62c-c76c10a1d525', '45d2b8b4-4e84-43b7-aa14-443bcc11cf4b'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:12 devstack quobyte-client[83246]: System call of process 101196 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51" returned: 0 in 0.777s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3852853b-fde6-43ef-a3e5-8c34920fc26b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadd797f-72ba-4196-8888-75724dea42bc]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.283s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:12 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Deleted volume successfully. Sep 16 23:16:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "cinder-41fbb234-d52a-4730-8a20-b63a4592e920-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-40658a65-dbda-4d72-b4f2-064cbb462ca1 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-b0b36f72-16d9-4e16-847b-ec68d496a0e3-delete_volume" released by "delete_volume" :: held 4.258s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:13 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-41fbb234-d52a-4730-8a20-b63a4592e920-delete_volume" acquired by "delete_volume" :: waited 0.238s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b" returned: 0 in 0.850s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:13 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 16 23:16:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51" returned: 0 in 0.452s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD" returned: 0 in 3.624s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "cinder-quobyte-41fbb234-d52a-4730-8a20-b63a4592e920" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b.c7d912f5-2215-441c-bd9a-acc3a7597c51" returned: 0 in 0.651s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-quobyte-c7d912f5-2215-441c-bd9a-acc3a7597c51" released by "_delete_snapshot" :: held 3.024s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-quobyte-41fbb234-d52a-4730-8a20-b63a4592e920" acquired by "delete_volume" :: waited 0.157s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:14 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[f211a046-d843-4fbd-ad3b-9a642e6bfdb3]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:14 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-quobyte-3852853b-fde6-43ef-a3e5-8c34920fc26b" released by "delete_snapshot" :: held 3.117s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-41fbb234-d52a-4730-8a20-b63a4592e920 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:14 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD Sep 16 23:16:14 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 23:16:15 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Created reservations ['c891f890-aa7b-4fb4-9ecd-f66cd808b99f', '7dbff441-8a1b-4c8a-bb72-c687b49797ae', '736441ce-75a2-4405-bff7-19928d655609', 'b11fbf7c-911c-4f49-a7ee-655cc58694e0'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:15 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Delete snapshot completed successfully. Sep 16 23:16:15 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8c5e83be-eed1-45cd-ac9f-2c3e0d0b12a2 tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-c7d912f5-2215-441c-bd9a-acc3a7597c51-delete_snapshot" released by "delete_snapshot" :: held 4.467s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-41fbb234-d52a-4730-8a20-b63a4592e920" returned: 0 in 1.131s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-41fbb234-d52a-4730-8a20-b63a4592e920 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-41fbb234-d52a-4730-8a20-b63a4592e920" returned: 0 in 0.205s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-quobyte-41fbb234-d52a-4730-8a20-b63a4592e920" released by "delete_volume" :: held 1.640s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "cinder-3852853b-fde6-43ef-a3e5-8c34920fc26b-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-3852853b-fde6-43ef-a3e5-8c34920fc26b-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:16 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Created reservations ['37ef3643-9f2c-4668-a4fe-469468f3f5ed', '3693a2fc-3ef0-4e38-b03d-ec8337340a2d', 'dadbbcbc-8946-4267-b950-20e171b76f61', '709072ca-06a5-4222-8475-a78144aebec2'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:16 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "cinder-quobyte-3852853b-fde6-43ef-a3e5-8c34920fc26b" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-quobyte-3852853b-fde6-43ef-a3e5-8c34920fc26b" acquired by "delete_volume" :: waited 0.063s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64a1ddd-fc7f-455e-9842-8f989b79697b]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.356s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:17 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "cinder-96e96ff1-1e7a-4a63-b2d3-6265a92858bb-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Deleted volume successfully. Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD" returned: 1 in 3.702s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf26b21-8437-47bd-82c9-1858a1a7c5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca014f5519e84945976f69ade3a7a305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:15:59Z,use_quota=True,user_id='b57cf3a067e9435baf47db117e66bc5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Creating volume bcf26b21-8437-47bd-82c9-1858a1a7c5d7 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:17 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:18 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=155, name=volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-96e96ff1-1e7a-4a63-b2d3-6265a92858bb-delete_volume" acquired by "delete_volume" :: waited 0.516s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b83c032-24fb-42a7-9e46-927b6626072e tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-41fbb234-d52a-4730-8a20-b63a4592e920-delete_volume" released by "delete_volume" :: held 5.028s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b" returned: 0 in 1.045s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 1073741824" returned: 0 in 0.778s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:18 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "cinder-quobyte-96e96ff1-1e7a-4a63-b2d3-6265a92858bb" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-3852853b-fde6-43ef-a3e5-8c34920fc26b" returned: 0 in 0.629s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7" returned: 0 in 0.324s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] <== create_volume: return (1141ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-quobyte-96e96ff1-1e7a-4a63-b2d3-6265a92858bb" acquired by "delete_volume" :: waited 0.198s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-quobyte-3852853b-fde6-43ef-a3e5-8c34920fc26b" released by "delete_volume" :: held 2.108s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c349dbc-e9ba-4e6a-ac0e-daf0f082b427]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Attempting download of 8d455306-4dab-4903-8b5a-c8226b72c5d9 ((None, None)) to volume bcf26b21-8437-47bd-82c9-1858a1a7c5d7. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfa9001-bfc5-409f-8357-d7ebcb249435]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d455306-4dab-4903-8b5a-c8226b72c5d9_63pl5swp {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb" returned: 0 in 0.812s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:20 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Created reservations ['c2a29c8a-5b7d-45c5-9137-55028165943a', '9b63b60b-8c3a-4314-ac4b-5747d0a3bd87', '4a47c377-08f9-4adb-b678-babbe3e89041', '81f3868a-6489-4ada-9efe-5e1073db4d37'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-96e96ff1-1e7a-4a63-b2d3-6265a92858bb" returned: 0 in 0.302s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d455306-4dab-4903-8b5a-c8226b72c5d9_63pl5swp" returned: 0 in 0.610s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d455306-4dab-4903-8b5a-c8226b72c5d9_63pl5swp {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:20 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-quobyte-96e96ff1-1e7a-4a63-b2d3-6265a92858bb" released by "delete_volume" :: held 1.593s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d455306-4dab-4903-8b5a-c8226b72c5d9_63pl5swp" returned: 1 in 0.564s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d455306-4dab-4903-8b5a-c8226b72c5d9_63pl5swp' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[d633144a-1315-4e64-a50d-b2b09fdd7d73]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "cinder-63bcedda-2ac2-4705-ae62-5c9f0d045faf-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.309s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-63bcedda-2ac2-4705-ae62-5c9f0d045faf-delete_volume" acquired by "delete_volume" :: waited 0.503s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:22 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Deleted volume successfully. Sep 16 23:16:22 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Created reservations ['d7dea45e-1434-4f76-ab20-b88ae2f9f4d5', 'a7e7594f-462d-441b-86d4-01e3e88cfcef', 'a5a2d63e-3b1b-429b-a863-141633ca3dd2', '0db7e0d9-4c48-4516-92c1-103dec3fcfd6'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-a944ba12-b93a-4947-8f4a-371e01de27db tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-3852853b-fde6-43ef-a3e5-8c34920fc26b-delete_volume" released by "delete_volume" :: held 5.738s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD" returned: 1 in 0.623s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:16:22 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] 8d455306-4dab-4903-8b5a-c8226b72c5d9 was raw, converting to raw {{(pid=83223) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 23:16:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:22 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=155, name=volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:22 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:22 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "cinder-quobyte-63bcedda-2ac2-4705-ae62-5c9f0d045faf" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7" returned: 0 in 0.425s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d455306-4dab-4903-8b5a-c8226b72c5d9_ynkdonmqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 23:16:23 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:23 devstack quobyte-client[83246]: System call of process 101279 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-quobyte-63bcedda-2ac2-4705-ae62-5c9f0d045faf" acquired by "delete_volume" :: waited 0.466s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "cinder-bd09deeb-50d2-46e9-8c13-70854e7196fd-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4feca94-6b81-442a-9603-ab456a10354b]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 1G" returned: 0 in 0.890s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-bd09deeb-50d2-46e9-8c13-70854e7196fd-delete_volume" acquired by "delete_volume" :: waited 0.578s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf" returned: 0 in 0.690s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.523s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:24 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd975fe8-324f-4226-84ad-5ff75b1cb461]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:24 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:24 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Deleted volume successfully. Sep 16 23:16:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-63bcedda-2ac2-4705-ae62-5c9f0d045faf" returned: 0 in 0.674s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:24 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "cinder-quobyte-bd09deeb-50d2-46e9-8c13-70854e7196fd" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-quobyte-63bcedda-2ac2-4705-ae62-5c9f0d045faf" released by "delete_volume" :: held 1.652s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-79523f93-57f5-4b16-aee1-dada533392b8 tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-96e96ff1-1e7a-4a63-b2d3-6265a92858bb-delete_volume" released by "delete_volume" :: held 6.809s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-quobyte-bd09deeb-50d2-46e9-8c13-70854e7196fd" acquired by "delete_volume" :: waited 0.112s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:25 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5448fa2f-547b-43eb-9e02-009a34fb8f7a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7" returned: 0 in 0.591s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bd09deeb-50d2-46e9-8c13-70854e7196fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bd09deeb-50d2-46e9-8c13-70854e7196fd" returned: 0 in 0.740s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bd09deeb-50d2-46e9-8c13-70854e7196fd {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7" returned: 1 in 0.949s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Created reservations ['9b89fe35-d019-41ee-932d-43e60b16b92c', '23d46a75-2606-4b8e-ac03-faf5e6979d3c', '24839d9f-8774-443f-9e63-0dc25cb6cb7a', '1374b15c-2a19-4cf6-a2b4-3bc0c3e2dee9'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Downloaded image 8d455306-4dab-4903-8b5a-c8226b72c5d9 ((None, None)) to volume bcf26b21-8437-47bd-82c9-1858a1a7c5d7 successfully. {{(pid=83223) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Temporary image 8d455306-4dab-4903-8b5a-c8226b72c5d9 for user b57cf3a067e9435baf47db117e66bc5c is deleted. {{(pid=83223) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.volume.volume_utils [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Marking volume bcf26b21-8437-47bd-82c9-1858a1a7c5d7 as bootable. {{(pid=83223) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bd09deeb-50d2-46e9-8c13-70854e7196fd" returned: 0 in 0.387s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Copying metadata from image 8d455306-4dab-4903-8b5a-c8226b72c5d9 to bcf26b21-8437-47bd-82c9-1858a1a7c5d7. {{(pid=83223) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Creating volume glance metadata for volume bcf26b21-8437-47bd-82c9-1858a1a7c5d7 backed by image 8d455306-4dab-4903-8b5a-c8226b72c5d9 with: {'image_id': '8d455306-4dab-4903-8b5a-c8226b72c5d9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a945b3d25ee5d78d9c04a6509f906fe4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83223) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-quobyte-bd09deeb-50d2-46e9-8c13-70854e7196fd" released by "delete_volume" :: held 1.244s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.373s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:26 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Deleted volume successfully. Sep 16 23:16:26 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Created reservations ['b08ab5e9-292e-486e-83d5-134f577c0e5f', '4e5da27b-7352-4d17-8759-615517ae9ba9', '88b33007-8612-425f-8a83-9f18c6453c9c', '649fae08-e675-40cb-bfbc-7eac87a70ba4'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc43f66-74b5-4de1-9f3e-2d1d1b62d78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7', 'volume_size': 1, 'image_id': '8d455306-4dab-4903-8b5a-c8226b72c5d9', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a945b3d25ee5d78d9c04a6509f906fe4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca014f5519e84945976f69ade3a7a305', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '67f772e08b8acf68a30765f079c62d3b3252f4fe978e4e7b0bbd2759fafd327d8aa9ca9c24bca4cf13f407995e1603493796fb38ec0c060b7de0815a2d6baaab', 'id': '8d455306-4dab-4903-8b5a-c8226b72c5d9', 'created_at': datetime.datetime(2025, 9, 16, 21, 15, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 21, 15, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d455306-4dab-4903-8b5a-c8226b72c5d9/file', 'properties': {}}, 'image_service': }' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9942312-d34d-40c0-8940-fd8e6b96a03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-8d34b326-c452-4a45-9589-98cc7af6bc2f tempest-CinderUnicodeTest-1651822757 None] Lock "cinder-63bcedda-2ac2-4705-ae62-5c9f0d045faf-delete_volume" released by "delete_volume" :: held 5.277s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:27 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Volume volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 (bcf26b21-8437-47bd-82c9-1858a1a7c5d7): created successfully Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9942312-d34d-40c0-8940-fd8e6b96a03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Flow 'volume_create_manager' (a9704459-b8e1-4ad8-8dfa-9018a1d647a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:27 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5e12600f-b888-4f5f-90a7-537f4d6dfb4c tempest-VolumeImageDependencyTests-597337229 None] Created volume successfully. Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.178s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:27 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Deleted volume successfully. Sep 16 23:16:27 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-90bbe120-99c7-40e4-8f66-43c9340094ba tempest-CreateVolumesFromImageTest-1406804545 None] Lock "cinder-bd09deeb-50d2-46e9-8c13-70854e7196fd-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Acquiring lock "cinder-bcf26b21-8437-47bd-82c9-1858a1a7c5d7-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Lock "cinder-bcf26b21-8437-47bd-82c9-1858a1a7c5d7-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:28 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Acquiring lock "cinder-quobyte-bcf26b21-8437-47bd-82c9-1858a1a7c5d7" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Lock "cinder-quobyte-bcf26b21-8437-47bd-82c9-1858a1a7c5d7" acquired by "delete_volume" :: waited 0.015s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:29 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[992eff7f-633d-405d-a240-795542d49c5d]: (4, 'raw') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.579s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:29 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7" returned: 0 in 0.579s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7" returned: 1 in 0.615s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7' failed. Not Retrying. {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 23:16:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-bcf26b21-8437-47bd-82c9-1858a1a7c5d7" returned: 0 in 0.193s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Lock "cinder-quobyte-bcf26b21-8437-47bd-82c9-1858a1a7c5d7" released by "delete_volume" :: held 2.066s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:31 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Created reservations ['60b4d557-4070-40d9-b5a5-edae0704a97f', 'bbca5f7c-38bc-42a5-a4ce-621439f2458e', 'f3737fad-def5-4db2-89da-ca26a4cd34e2', 'f6bc3352-fb1f-4123-b747-fb37e999208b'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:31 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.124s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:31 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:31 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Deleted volume successfully. Sep 16 23:16:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-f9586b5c-6aa7-4540-9937-d255f7b1025c tempest-VolumeImageDependencyTests-597337229 None] Lock "cinder-bcf26b21-8437-47bd-82c9-1858a1a7c5d7-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:32 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:32 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:16:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (903883a3-27a6-490e-a25b-372acc978d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:32 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c877584-5905-401c-96f3-f3caa012f006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c877584-5905-401c-96f3-f3caa012f006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1641047214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567d8f5b-ba4c-42b2-8ed6-c465321d3a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:33Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6f4187-b3da-48d5-bb0c-2bc05870566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6f4187-b3da-48d5-bb0c-2bc05870566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc993965-9999-491f-a165-49fa2545b579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc993965-9999-491f-a165-49fa2545b579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '567d8f5b-ba4c-42b2-8ed6-c465321d3a0a', 'volume_name': 'volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b2ae1a-c799-4120-9cae-f31461af517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b2ae1a-c799-4120-9cae-f31461af517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f566165-d0d0-4719-a8f7-a467aa6b8ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:33 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume 567d8f5b-ba4c-42b2-8ed6-c465321d3a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a', 'volume_size': 1} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1641047214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567d8f5b-ba4c-42b2-8ed6-c465321d3a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:33Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Creating volume 567d8f5b-ba4c-42b2-8ed6-c465321d3a0a {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:33 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:33 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=156, name=volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a 1073741824" returned: 0 in 0.412s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" returned: 0 in 0.167s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] <== create_volume: return (744ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f566165-d0d0-4719-a8f7-a467aa6b8ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf210464-209e-48c7-8beb-8cd8a4397124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:34 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a (567d8f5b-ba4c-42b2-8ed6-c465321d3a0a): created successfully Sep 16 23:16:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf210464-209e-48c7-8beb-8cd8a4397124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:34 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (903883a3-27a6-490e-a25b-372acc978d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:34 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a0ff6280-c546-4b39-b5b9-37bbf10c3827 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created volume successfully. Sep 16 23:16:35 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Creating offline snapshot 5ee87d13-65e3-459a-97cc-c204ab31da8c of volume 567d8f5b-ba4c-42b2-8ed6-c465321d3a0a {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 23:16:35 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d90edc-08de-4cf6-8a40-9dac320849c1]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" returned: 0 in 0.462s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:36 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=157, name=volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c 1G" returned: 0 in 0.241s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): qemu-img rebase -u -b volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:36 devstack quobyte-client[83246]: System call of process 101322 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "qemu-img rebase -u -b volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c" returned: 0 in 0.207s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c" returned: 0 in 0.092s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c" returned: 0 in 0.121s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.info" returned: 0 in 0.131s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:16:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.info" returned: 0 in 0.096s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.753s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:37 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-a430bf1a-fd18-4472-8dba-d8325638b23e tempest-CreateVolumesFromSnapshotTest-1184095211 None] Create snapshot completed successfully Sep 16 23:16:39 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (eaf511a9-e476-4e00-8ed7-0c1a5e7a873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884c6577-f136-4338-b6cd-c0bae26a6e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884c6577-f136-4338-b6cd-c0bae26a6e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1385362030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60727c1d-677c-41e4-934a-3e966b8e300b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:39Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46de8d44-ae00-455e-99bb-8894f8632737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46de8d44-ae00-455e-99bb-8894f8632737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af792195-2df3-4583-a6f9-0705e41e1b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af792195-2df3-4583-a6f9-0705e41e1b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60727c1d-677c-41e4-934a-3e966b8e300b', 'volume_name': 'volume-60727c1d-677c-41e4-934a-3e966b8e300b', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde22004-5362-433b-8a68-3c35e5e8d01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde22004-5362-433b-8a68-3c35e5e8d01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b2a383-0c9c-486b-9cb0-2ff39c32f242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:39 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume 60727c1d-677c-41e4-934a-3e966b8e300b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60727c1d-677c-41e4-934a-3e966b8e300b', 'volume_size': 1} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1385362030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60727c1d-677c-41e4-934a-3e966b8e300b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:39Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Creating volume 60727c1d-677c-41e4-934a-3e966b8e300b {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:39 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-60727c1d-677c-41e4-934a-3e966b8e300b 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:39 devstack quobyte-client[83246]: System call of process 101329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:16:39 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=159, name=volume-60727c1d-677c-41e4-934a-3e966b8e300b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-60727c1d-677c-41e4-934a-3e966b8e300b 1073741824" returned: 0 in 0.710s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:39 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-60727c1d-677c-41e4-934a-3e966b8e300b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:40 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (1fdbe4dc-d4cd-4c6e-bde8-ef67b8253e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68694734-4c2b-499d-bd37-58ede81bb8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68694734-4c2b-499d-bd37-58ede81bb8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1410423486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79253b87-cf73-46df-961a-4abdb8257064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:39Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac8c171-7372-4b70-8697-f00b37edd8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac8c171-7372-4b70-8697-f00b37edd8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cace1db3-5b80-4da9-b402-42a58b583875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cace1db3-5b80-4da9-b402-42a58b583875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79253b87-cf73-46df-961a-4abdb8257064', 'volume_name': 'volume-79253b87-cf73-46df-961a-4abdb8257064', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25053d2d-4f9d-4008-89b5-a9270620dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25053d2d-4f9d-4008-89b5-a9270620dd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c270422e-4cc9-420b-870b-9ee1b979c699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:40 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume 79253b87-cf73-46df-961a-4abdb8257064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79253b87-cf73-46df-961a-4abdb8257064', 'volume_size': 1} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-60727c1d-677c-41e4-934a-3e966b8e300b" returned: 0 in 0.943s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:40 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (4c3f3bb7-4d24-408a-93d3-69999f1c8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:40 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc1e9d9-53e4-48ee-aa30-03edc87b79f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] <== create_volume: return (1787ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc1e9d9-53e4-48ee-aa30-03edc87b79f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-621366695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80d7c49-b1f6-4770-9f09-22221f5d426d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:40Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f43ce2-f3a6-469f-a610-1e9639318e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f43ce2-f3a6-469f-a610-1e9639318e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cc07b2-590c-4af2-bbb9-60290acc06ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cc07b2-590c-4af2-bbb9-60290acc06ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b80d7c49-b1f6-4770-9f09-22221f5d426d', 'volume_name': 'volume-b80d7c49-b1f6-4770-9f09-22221f5d426d', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb397f0-4c38-4eca-9178-05b94477e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb397f0-4c38-4eca-9178-05b94477e229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad17ad9-b3c6-4caa-b716-50f621464348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:41 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume b80d7c49-b1f6-4770-9f09-22221f5d426d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b80d7c49-b1f6-4770-9f09-22221f5d426d', 'volume_size': 1} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-621366695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80d7c49-b1f6-4770-9f09-22221f5d426d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:40Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Creating volume b80d7c49-b1f6-4770-9f09-22221f5d426d {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:41 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b80d7c49-b1f6-4770-9f09-22221f5d426d 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:41 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=160, name=volume-b80d7c49-b1f6-4770-9f09-22221f5d426d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b2a383-0c9c-486b-9cb0-2ff39c32f242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60727c1d-677c-41e4-934a-3e966b8e300b', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9899821d-a330-44c4-9146-2785e8ab2cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:41 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:41 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (27b7883f-bc44-41b5-9733-e9acd0ec9da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8011c49-1872-42f8-84db-606ca5c8c88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:42 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (def1464f-19de-499d-bbc6-2b468b9e2054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4190b9-53e8-42c8-9fe6-742517cf0e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:42 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume volume-60727c1d-677c-41e4-934a-3e966b8e300b (60727c1d-677c-41e4-934a-3e966b8e300b): created successfully Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9899821d-a330-44c4-9146-2785e8ab2cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (eaf511a9-e476-4e00-8ed7-0c1a5e7a873a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8011c49-1872-42f8-84db-606ca5c8c88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-5246081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febe979a-6bdc-4e06-95a5-8af0780fc07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:40Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059053c7-61a9-4300-b7aa-506a1a5f49ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059053c7-61a9-4300-b7aa-506a1a5f49ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515a2709-d996-4181-ac55-60e89975fe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515a2709-d996-4181-ac55-60e89975fe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'febe979a-6bdc-4e06-95a5-8af0780fc07e', 'volume_name': 'volume-febe979a-6bdc-4e06-95a5-8af0780fc07e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca96bef6-4c8d-422c-9695-0dc3785ed2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca96bef6-4c8d-422c-9695-0dc3785ed2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac027a3c-d7c1-4022-9760-a54876d4e8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:42 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume febe979a-6bdc-4e06-95a5-8af0780fc07e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-febe979a-6bdc-4e06-95a5-8af0780fc07e', 'volume_size': 1} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b80d7c49-b1f6-4770-9f09-22221f5d426d 1073741824" returned: 0 in 1.266s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b80d7c49-b1f6-4770-9f09-22221f5d426d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:42 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-1bd18177-564c-4ad1-ad6f-cc57c557aca6 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created volume successfully. Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4190b9-53e8-42c8-9fe6-742517cf0e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-268182729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5567bb9e-5582-48e0-b900-fa9cffa7a127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:41Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830bbd88-c70e-4cfa-8be0-72d75772dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830bbd88-c70e-4cfa-8be0-72d75772dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9665288b-9982-43c5-a589-068ac8341c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9665288b-9982-43c5-a589-068ac8341c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5567bb9e-5582-48e0-b900-fa9cffa7a127', 'volume_name': 'volume-5567bb9e-5582-48e0-b900-fa9cffa7a127', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d331f0e-4f1b-432f-9b7c-4a35c63e6386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d331f0e-4f1b-432f-9b7c-4a35c63e6386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153d79c4-2eb3-4c58-8383-e79d6b2418bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:42 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume 5567bb9e-5582-48e0-b900-fa9cffa7a127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5567bb9e-5582-48e0-b900-fa9cffa7a127', 'volume_size': 1} Sep 16 23:16:42 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b80d7c49-b1f6-4770-9f09-22221f5d426d" returned: 0 in 0.671s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] <== create_volume: return (1958ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.206s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1410423486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79253b87-cf73-46df-961a-4abdb8257064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:39Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Creating volume 79253b87-cf73-46df-961a-4abdb8257064 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:43 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-79253b87-cf73-46df-961a-4abdb8257064 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:43 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=161, name=volume-79253b87-cf73-46df-961a-4abdb8257064, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad17ad9-b3c6-4caa-b716-50f621464348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80d7c49-b1f6-4770-9f09-22221f5d426d', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd3bf97-f66e-433e-8c4c-db3c1b4dff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:43 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume volume-b80d7c49-b1f6-4770-9f09-22221f5d426d (b80d7c49-b1f6-4770-9f09-22221f5d426d): created successfully Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd3bf97-f66e-433e-8c4c-db3c1b4dff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (4c3f3bb7-4d24-408a-93d3-69999f1c8d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-79253b87-cf73-46df-961a-4abdb8257064 1073741824" returned: 0 in 0.758s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:43 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-79253b87-cf73-46df-961a-4abdb8257064 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:44 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-00e25f1d-7ba2-419c-8e4f-2802764d26fe tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created volume successfully. Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-79253b87-cf73-46df-961a-4abdb8257064" returned: 0 in 0.283s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] <== create_volume: return (1100ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.900s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-5246081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febe979a-6bdc-4e06-95a5-8af0780fc07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:40Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Creating volume febe979a-6bdc-4e06-95a5-8af0780fc07e {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:44 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-febe979a-6bdc-4e06-95a5-8af0780fc07e 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:44 devstack quobyte-client[83246]: System call of process 101341 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:16:44 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=162, name=volume-febe979a-6bdc-4e06-95a5-8af0780fc07e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c270422e-4cc9-420b-870b-9ee1b979c699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79253b87-cf73-46df-961a-4abdb8257064', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d73709-9a96-436d-bd08-bdfc82f5a5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:44 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume volume-79253b87-cf73-46df-961a-4abdb8257064 (79253b87-cf73-46df-961a-4abdb8257064): created successfully Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d73709-9a96-436d-bd08-bdfc82f5a5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (1fdbe4dc-d4cd-4c6e-bde8-ef67b8253e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-febe979a-6bdc-4e06-95a5-8af0780fc07e 1073741824" returned: 0 in 0.531s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:44 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-febe979a-6bdc-4e06-95a5-8af0780fc07e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:45 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-4d0ae107-dc4c-4796-ad7b-2c87e1cda7ba tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created volume successfully. Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-febe979a-6bdc-4e06-95a5-8af0780fc07e" returned: 0 in 0.346s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] <== create_volume: return (948ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-268182729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5567bb9e-5582-48e0-b900-fa9cffa7a127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7933ee4bb6e1454dbdd9a5a626515e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:16:41Z,use_quota=True,user_id='cd5f10fd212b4c5b94c99ea78b5623e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Creating volume 5567bb9e-5582-48e0-b900-fa9cffa7a127 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:16:45 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5567bb9e-5582-48e0-b900-fa9cffa7a127 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:45 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=163, name=volume-5567bb9e-5582-48e0-b900-fa9cffa7a127, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac027a3c-d7c1-4022-9760-a54876d4e8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-febe979a-6bdc-4e06-95a5-8af0780fc07e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedc14e2-3013-42b8-9ef7-5a1139aeac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5567bb9e-5582-48e0-b900-fa9cffa7a127 1073741824" returned: 0 in 0.590s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:45 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5567bb9e-5582-48e0-b900-fa9cffa7a127 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:46 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume volume-febe979a-6bdc-4e06-95a5-8af0780fc07e (febe979a-6bdc-4e06-95a5-8af0780fc07e): created successfully Sep 16 23:16:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedc14e2-3013-42b8-9ef7-5a1139aeac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (27b7883f-bc44-41b5-9733-e9acd0ec9da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5567bb9e-5582-48e0-b900-fa9cffa7a127" returned: 0 in 0.344s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:46 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] <== create_volume: return (968ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:16:46 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:46 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d2f19b46-cc62-4062-a253-bbe051bce5b0 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created volume successfully. Sep 16 23:16:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153d79c4-2eb3-4c58-8383-e79d6b2418bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5567bb9e-5582-48e0-b900-fa9cffa7a127', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fb6044-6edf-4c16-97f4-c8202b202acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:16:46 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume volume-5567bb9e-5582-48e0-b900-fa9cffa7a127 (5567bb9e-5582-48e0-b900-fa9cffa7a127): created successfully Sep 16 23:16:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fb6044-6edf-4c16-97f4-c8202b202acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:16:46 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Flow 'volume_create_manager' (def1464f-19de-499d-bbc6-2b468b9e2054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:16:46 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-4338c3f9-4bc1-462b-aa31-3ff5dcf8ee38 tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created volume successfully. Sep 16 23:16:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-5567bb9e-5582-48e0-b900-fa9cffa7a127-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-5567bb9e-5582-48e0-b900-fa9cffa7a127-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:47 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-quobyte-5567bb9e-5582-48e0-b900-fa9cffa7a127" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:47 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-5567bb9e-5582-48e0-b900-fa9cffa7a127" acquired by "delete_volume" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:47 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe76dd80-8527-4f58-b089-5a1f24d97cf3]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5567bb9e-5582-48e0-b900-fa9cffa7a127 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5567bb9e-5582-48e0-b900-fa9cffa7a127" returned: 0 in 0.488s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:47 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5567bb9e-5582-48e0-b900-fa9cffa7a127 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-5567bb9e-5582-48e0-b900-fa9cffa7a127" returned: 0 in 0.136s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-5567bb9e-5582-48e0-b900-fa9cffa7a127" released by "delete_volume" :: held 0.841s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created reservations ['e7a4e2b8-1b32-4089-874f-282046ffdb2e', 'ae77a45d-6686-49b1-9909-08699a2f21a8', '8d6c9303-7bc2-40c7-96f4-b4d76f5d598e', '2f012574-14f2-4e56-a89c-3d3c868b3307'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.121s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:48 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:48 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Deleted volume successfully. Sep 16 23:16:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dee67fc6-d5c3-42bd-8f70-f8af67de9c3a tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-5567bb9e-5582-48e0-b900-fa9cffa7a127-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-febe979a-6bdc-4e06-95a5-8af0780fc07e-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-febe979a-6bdc-4e06-95a5-8af0780fc07e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:49 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-quobyte-febe979a-6bdc-4e06-95a5-8af0780fc07e" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:49 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-febe979a-6bdc-4e06-95a5-8af0780fc07e" acquired by "delete_volume" :: waited 0.017s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:49 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bde37d-e670-4182-a25f-284ff971985a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:49 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-febe979a-6bdc-4e06-95a5-8af0780fc07e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-febe979a-6bdc-4e06-95a5-8af0780fc07e" returned: 0 in 0.475s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-febe979a-6bdc-4e06-95a5-8af0780fc07e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:50 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-febe979a-6bdc-4e06-95a5-8af0780fc07e" returned: 0 in 0.096s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:50 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-febe979a-6bdc-4e06-95a5-8af0780fc07e" released by "delete_volume" :: held 0.741s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:50 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created reservations ['687c6452-fbcb-4e80-a172-7825b14b9e02', 'a7d94cf5-131f-4f9c-9e22-9cd62138a809', '991e9e8e-ab9e-4341-b309-55cff1e7e864', '969e0168-b20f-4547-8080-43ccf9c07641'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.099s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:51 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Deleted volume successfully. Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-667d7280-73ce-485a-b79d-9bfb29f4a6db tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-febe979a-6bdc-4e06-95a5-8af0780fc07e-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-b80d7c49-b1f6-4770-9f09-22221f5d426d-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-b80d7c49-b1f6-4770-9f09-22221f5d426d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:51 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=85,cinder:UPDATE=117,cinder:DELETE=12,cinder:INSERT=31 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:16:52 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=70,cinder:UPDATE=118,cinder:DELETE=14,cinder:INSERT=22 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:16:52 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-quobyte-b80d7c49-b1f6-4770-9f09-22221f5d426d" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-b80d7c49-b1f6-4770-9f09-22221f5d426d" acquired by "delete_volume" :: waited 0.014s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:52 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[8913394b-8698-40d7-99b6-acddfebd9fff]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b80d7c49-b1f6-4770-9f09-22221f5d426d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b80d7c49-b1f6-4770-9f09-22221f5d426d" returned: 0 in 0.472s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b80d7c49-b1f6-4770-9f09-22221f5d426d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:52 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-b80d7c49-b1f6-4770-9f09-22221f5d426d" returned: 0 in 0.093s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:52 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-b80d7c49-b1f6-4770-9f09-22221f5d426d" released by "delete_volume" :: held 0.763s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:53 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created reservations ['c3467e09-23bc-4f55-9ba4-fbe867fd67fa', 'ee47ba49-ea0a-404c-a802-e6aabc783cc9', '28f09c25-6fb6-4649-9f8f-405201f20c9c', '96bd7624-ca69-46e4-9e27-77b060291b78'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:53 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:53 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.092s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:53 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:53 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Deleted volume successfully. Sep 16 23:16:53 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-10eff687-6138-44e1-82f2-4a663065dfac tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-b80d7c49-b1f6-4770-9f09-22221f5d426d-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-79253b87-cf73-46df-961a-4abdb8257064-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-79253b87-cf73-46df-961a-4abdb8257064-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:54 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-quobyte-79253b87-cf73-46df-961a-4abdb8257064" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:54 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-79253b87-cf73-46df-961a-4abdb8257064" acquired by "delete_volume" :: waited 0.022s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:54 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[2471dce0-4bb7-4c56-9b16-259fc27703d3]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:54 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-79253b87-cf73-46df-961a-4abdb8257064 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-79253b87-cf73-46df-961a-4abdb8257064" returned: 0 in 0.711s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-79253b87-cf73-46df-961a-4abdb8257064 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:55 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-79253b87-cf73-46df-961a-4abdb8257064" returned: 0 in 0.255s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:55 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-79253b87-cf73-46df-961a-4abdb8257064" released by "delete_volume" :: held 1.258s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:56 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created reservations ['09ec01b6-da20-4e9b-a517-f5d1db432330', '6e2fbee8-670a-4d08-9664-7719a48c0654', '80753cd5-1609-4d6a-a36d-1076224fb550', '1aef62f5-746b-47c8-a57d-e746d4420e3f'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:56 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:56 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.106s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:56 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:56 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Deleted volume successfully. Sep 16 23:16:56 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-60727c1d-677c-41e4-934a-3e966b8e300b-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-60727c1d-677c-41e4-934a-3e966b8e300b-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-e15a7c92-7f34-4c29-bb9f-a2d0379c0d2d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-79253b87-cf73-46df-961a-4abdb8257064-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:57 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-quobyte-60727c1d-677c-41e4-934a-3e966b8e300b" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-60727c1d-677c-41e4-934a-3e966b8e300b" acquired by "delete_volume" :: waited 0.009s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:57 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a32d2bf-4113-4e6a-b1de-e85effcb0934]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-60727c1d-677c-41e4-934a-3e966b8e300b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-60727c1d-677c-41e4-934a-3e966b8e300b" returned: 0 in 0.427s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-60727c1d-677c-41e4-934a-3e966b8e300b {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:57 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-60727c1d-677c-41e4-934a-3e966b8e300b" returned: 0 in 0.096s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:57 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-60727c1d-677c-41e4-934a-3e966b8e300b" released by "delete_volume" :: held 0.686s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:58 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created reservations ['9e4ee53e-00e6-4d2b-ba98-0d8f6028f222', 'e7ef7411-62be-4814-aa8a-b4f6051367e7', '0e816ffd-7a5f-45fa-bc59-e4917d38316c', '69b1c0ed-2b93-42bf-b58e-514dfa4ee4fb'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:16:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:16:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:16:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:16:58 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:16:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:16:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:58 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.125s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:58 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:16:58 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Deleted volume successfully. Sep 16 23:16:58 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-6e50a0e6-3967-41b6-83dc-14278658c7cc tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-60727c1d-677c-41e4-934a-3e966b8e300b-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-5ee87d13-65e3-459a-97cc-c204ab31da8c-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-5ee87d13-65e3-459a-97cc-c204ab31da8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:59 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-quobyte-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-quobyte-5ee87d13-65e3-459a-97cc-c204ab31da8c" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-5ee87d13-65e3-459a-97cc-c204ab31da8c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Deleting offline snapshot 5ee87d13-65e3-459a-97cc-c204ab31da8c of volume 567d8f5b-ba4c-42b2-8ed6-c465321d3a0a {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] snapshot_file for this snap is: volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[479853b0-ba34-400d-92ef-821e7ac8cb44]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c" returned: 0 in 0.427s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba6fbcd-3112-4cf5-b860-be9066e14eb8]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:16:59 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" returned: 0 in 0.539s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c" returned: 0 in 0.254s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:00 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a.5ee87d13-65e3-459a-97cc-c204ab31da8c" returned: 0 in 0.124s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-5ee87d13-65e3-459a-97cc-c204ab31da8c" released by "_delete_snapshot" :: held 1.693s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" released by "delete_snapshot" :: held 1.727s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:01 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created reservations ['b76acdf4-cbbb-4489-82ee-1580c6bb3bf2', 'ae9ee0fe-7867-4b69-acb9-04e3992a613c', '417bc18a-1acc-45e3-ba2f-c3b43418d42f', '242359a4-2dba-4fbb-8015-2845ee355153'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:01 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Delete snapshot completed successfully. Sep 16 23:17:01 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dd3b1aef-2a7f-4a68-b10c-d82c9ae8cc4d tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-5ee87d13-65e3-459a-97cc-c204ab31da8c-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:02 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "cinder-quobyte-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:02 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" acquired by "delete_volume" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:02 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fd5f22-371d-4dab-8d1c-f556e30d3144]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:02 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" returned: 0 in 0.453s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" returned: 0 in 0.121s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-quobyte-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a" released by "delete_volume" :: held 0.763s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Created reservations ['fc7837c7-5f3d-4ad5-8dc6-40113cde1092', '4ba57fe8-347b-4406-846a-f68ff00a4e40', '125f2982-29f9-43f2-aa10-86b715ac9b06', '4aa8ee62-f447-4396-9dde-7d0918757a7a'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.109s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:03 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:17:04 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Deleted volume successfully. Sep 16 23:17:04 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4ba541da-87ae-43be-9458-103ab53c2dce tempest-CreateVolumesFromSnapshotTest-1184095211 None] Lock "cinder-567d8f5b-ba4c-42b2-8ed6-c465321d3a0a-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:05 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:05 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:17:05 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Flow 'volume_create_manager' (6e1bc4ef-b0f6-482f-b164-aa4865e02342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bf6888-e228-4969-b0c0-294186c718bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bf6888-e228-4969-b0c0-294186c718bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-604630305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77611aba-dede-495c-841b-bc7ff08eca49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ffd2bb1e7b4bb2975cdcba39ffc252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:06Z,use_quota=True,user_id='a207c4f9f92943539c428f0d3023398f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eef3f87-d7f8-42cd-8b02-2291b213e310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eef3f87-d7f8-42cd-8b02-2291b213e310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce56db08-d30d-4c61-8634-b6ed6afa6ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce56db08-d30d-4c61-8634-b6ed6afa6ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77611aba-dede-495c-841b-bc7ff08eca49', 'volume_name': 'volume-77611aba-dede-495c-841b-bc7ff08eca49', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279a0c46-8c22-4bc8-9ad3-33d47ad3c6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279a0c46-8c22-4bc8-9ad3-33d47ad3c6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fee3cc1-7ceb-4029-9832-4b8de444c0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:06 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Volume 77611aba-dede-495c-841b-bc7ff08eca49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77611aba-dede-495c-841b-bc7ff08eca49', 'volume_size': 1} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-604630305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77611aba-dede-495c-841b-bc7ff08eca49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ffd2bb1e7b4bb2975cdcba39ffc252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:06Z,use_quota=True,user_id='a207c4f9f92943539c428f0d3023398f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Creating volume 77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:17:06 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:06 devstack quobyte-client[83246]: System call of process 101401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:17:06 devstack quobyte-client[83246]: System call of process 101401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:17:06 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=164, name=volume-77611aba-dede-495c-841b-bc7ff08eca49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 1073741824" returned: 0 in 0.334s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49" returned: 0 in 0.104s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] <== create_volume: return (520ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.541s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fee3cc1-7ceb-4029-9832-4b8de444c0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77611aba-dede-495c-841b-bc7ff08eca49', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ffdaae-870f-43eb-8f21-a1c4df7e98d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:06 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Volume volume-77611aba-dede-495c-841b-bc7ff08eca49 (77611aba-dede-495c-841b-bc7ff08eca49): created successfully Sep 16 23:17:06 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ffdaae-870f-43eb-8f21-a1c4df7e98d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Flow 'volume_create_manager' (6e1bc4ef-b0f6-482f-b164-aa4865e02342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:07 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-4360fc50-2e45-4e65-8a8f-2dbdcf120698 tempest-SnapshotDependencyTests-554899884 None] Created volume successfully. Sep 16 23:17:07 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (1632073a-7c60-43b7-83f8-924127f8031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedcaa08-1682-4f8c-a39b-400e196d2cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bedcaa08-1682-4f8c-a39b-400e196d2cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1707167742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:08Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de04cb12-c494-41d5-874d-6f73161aef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de04cb12-c494-41d5-874d-6f73161aef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b350648-fb23-48ea-8260-36fa935bea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b350648-fb23-48ea-8260-36fa935bea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a', 'volume_name': 'volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457090fa-5c89-4282-adc8-af8e6f638c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457090fa-5c89-4282-adc8-af8e6f638c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edc18b0-87ab-44c7-9ef8-d082b1ee2b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:07 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume 9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a', 'volume_size': 1} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1707167742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:08Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Creating volume 9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:17:07 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:17:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:08 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=165, name=volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a 1073741824" returned: 0 in 0.354s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a" returned: 0 in 0.346s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] <== create_volume: return (763ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:08 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5edc18b0-87ab-44c7-9ef8-d082b1ee2b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e891a8-0251-4d5f-846f-90842e3945c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:08 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a (9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a): created successfully Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e891a8-0251-4d5f-846f-90842e3945c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (1632073a-7c60-43b7-83f8-924127f8031d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Creating offline snapshot 7399814c-2d55-4d73-b47e-0176c338d8b4 of volume 77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 23:17:08 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-075a7e41-6bfe-4e26-83ce-ad9fd707300e tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created volume successfully. Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e704fa0-1e26-4c07-88fe-e36c2438a4ab]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49" returned: 0 in 0.411s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 1G {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:09 devstack quobyte-client[83246]: System call of process 101412 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:17:09 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=166, name=volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:17:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 1G" returned: 0 in 0.253s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): qemu-img rebase -u -b volume-77611aba-dede-495c-841b-bc7ff08eca49 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] CMD "qemu-img rebase -u -b volume-77611aba-dede-495c-841b-bc7ff08eca49 -F qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4" returned: 0 in 0.143s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:17:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:09 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4" returned: 0 in 0.103s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:09 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Setting permissions: /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 -> 1000:1000 {{(pid=83223) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 23:17:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4" returned: 0 in 0.122s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.info" returned: 0 in 0.426s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:10 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.info is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:17:10 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.info {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:10 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:10 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:17:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (0cb4035a-d372-4766-9d20-7e68c7d5df21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:10 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a607f79-0faa-4b0d-8606-c65ef2d43621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a607f79-0faa-4b0d-8606-c65ef2d43621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-892724318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eab625f-b1cb-4951-9ec7-69fd2bbb94a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:10Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119dd6c7-d6e2-4100-a7e9-04999c18a6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119dd6c7-d6e2-4100-a7e9-04999c18a6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b373c963-d418-4612-a935-340b6d688991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b373c963-d418-4612-a935-340b6d688991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eab625f-b1cb-4951-9ec7-69fd2bbb94a9', 'volume_name': 'volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1597fc34-29e3-493d-a78a-4179d7ca5ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1597fc34-29e3-493d-a78a-4179d7ca5ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee653e8-cc63-4756-97d1-07c8ea079af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:11 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume 8eab625f-b1cb-4951-9ec7-69fd2bbb94a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9', 'volume_size': 1} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.info" returned: 0 in 0.637s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-892724318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eab625f-b1cb-4951-9ec7-69fd2bbb94a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:10Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Creating volume 8eab625f-b1cb-4951-9ec7-69fd2bbb94a9 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:17:11 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:11 devstack quobyte-client[83246]: System call of process 101422 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:17:11 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=168, name=volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:17:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (aa0cec3a-9e75-4aa5-b410-6a6c455ca047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d905acc6-b921-444c-9fdc-155261c1dbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:11 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (71fc8ba6-1d5f-4786-9682-f77369d6fb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:11 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03696e59-c21a-44d5-92c6-4cb8be99877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d905acc6-b921-444c-9fdc-155261c1dbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-298032359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2942131-c9c6-4966-93c3-a8d1f65d751d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:11Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f5e84b-ac2b-4ff2-9ef4-a51046131230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f5e84b-ac2b-4ff2-9ef4-a51046131230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e8de29-350b-4ff1-ae01-476a9f9272ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e8de29-350b-4ff1-ae01-476a9f9272ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2942131-c9c6-4966-93c3-a8d1f65d751d', 'volume_name': 'volume-e2942131-c9c6-4966-93c3-a8d1f65d751d', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d992fb7f-95a1-4a89-8cc8-ae584f4e08bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d992fb7f-95a1-4a89-8cc8-ae584f4e08bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf029fe0-c68a-40a7-90ca-698f41a192ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume e2942131-c9c6-4966-93c3-a8d1f65d751d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2942131-c9c6-4966-93c3-a8d1f65d751d', 'volume_size': 1} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:12 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-7b9b08a1-d585-444e-9189-053604b9e463 tempest-SnapshotDependencyTests-554899884 None] Create snapshot completed successfully Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9 1073741824" returned: 0 in 0.839s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03696e59-c21a-44d5-92c6-4cb8be99877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-630821987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f01ee03-f885-45fc-85b7-860c8b43923d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:11Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8041165-ee7d-4914-95ff-755f99ceda7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8041165-ee7d-4914-95ff-755f99ceda7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122f7c78-38a4-499c-8cd2-792b73151a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122f7c78-38a4-499c-8cd2-792b73151a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f01ee03-f885-45fc-85b7-860c8b43923d', 'volume_name': 'volume-0f01ee03-f885-45fc-85b7-860c8b43923d', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6c0891-595f-4386-b381-a1638dc46161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6c0891-595f-4386-b381-a1638dc46161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f9c70f-4731-46ba-a96b-e5504f9bc9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume 0f01ee03-f885-45fc-85b7-860c8b43923d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f01ee03-f885-45fc-85b7-860c8b43923d', 'volume_size': 1} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:12 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (4683a442-89ac-4b9f-9b9a-d32fea4c78db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b405dfdc-e7ce-46c9-bf5c-54ce9a80524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9" returned: 0 in 0.547s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] <== create_volume: return (1421ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-298032359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2942131-c9c6-4966-93c3-a8d1f65d751d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:11Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Creating volume e2942131-c9c6-4966-93c3-a8d1f65d751d {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:17:12 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e2942131-c9c6-4966-93c3-a8d1f65d751d 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:12 devstack quobyte-client[83246]: System call of process 101426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:17:12 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=169, name=volume-e2942131-c9c6-4966-93c3-a8d1f65d751d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b405dfdc-e7ce-46c9-bf5c-54ce9a80524b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1004883263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f27a7fc-a391-47b8-bbc2-cce8d0593fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:11Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77892ae-38f4-4d58-9906-da4371bf2067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77892ae-38f4-4d58-9906-da4371bf2067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94e7abf-2131-4a02-ae47-2f462365c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:12 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94e7abf-2131-4a02-ae47-2f462365c22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f27a7fc-a391-47b8-bbc2-cce8d0593fe5', 'volume_name': 'volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379ccc6e-a37c-427f-a2ab-7b5417f38eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379ccc6e-a37c-427f-a2ab-7b5417f38eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41dcdf3-af17-4ed7-82d8-7cdf18c535b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:13 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume 2f27a7fc-a391-47b8-bbc2-cce8d0593fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5', 'volume_size': 1} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:13 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (cbdad0d2-4eb2-440e-a1d6-e32cc3c2d7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e88359-d859-4db7-b0bd-4e8a7b6a71c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e88359-d859-4db7-b0bd-4e8a7b6a71c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-602198219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25735e3e-0d6c-483b-8a2e-f12d7186976e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:12Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7c0245-204d-4fcf-83aa-4c5b6d2afca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7c0245-204d-4fcf-83aa-4c5b6d2afca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a1fb44-d47c-43f4-9fc5-67655b44bd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a1fb44-d47c-43f4-9fc5-67655b44bd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25735e3e-0d6c-483b-8a2e-f12d7186976e', 'volume_name': 'volume-25735e3e-0d6c-483b-8a2e-f12d7186976e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098bcdde-8eb1-44ca-93d3-ec124f4851bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098bcdde-8eb1-44ca-93d3-ec124f4851bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe5c8e9-ad52-453c-b26b-e56d76c4333c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:13 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume 25735e3e-0d6c-483b-8a2e-f12d7186976e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25735e3e-0d6c-483b-8a2e-f12d7186976e', 'volume_size': 1} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee653e8-cc63-4756-97d1-07c8ea079af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfcfc30-dc01-46d0-a59e-21bf6f753575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e2942131-c9c6-4966-93c3-a8d1f65d751d 1073741824" returned: 0 in 0.679s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e2942131-c9c6-4966-93c3-a8d1f65d751d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:13 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9 (8eab625f-b1cb-4951-9ec7-69fd2bbb94a9): created successfully Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfcfc30-dc01-46d0-a59e-21bf6f753575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (0cb4035a-d372-4766-9d20-7e68c7d5df21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e2942131-c9c6-4966-93c3-a8d1f65d751d" returned: 0 in 0.481s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] <== create_volume: return (1181ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.526s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-630821987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f01ee03-f885-45fc-85b7-860c8b43923d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:11Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Creating volume 0f01ee03-f885-45fc-85b7-860c8b43923d {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:17:13 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:17:13 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f01ee03-f885-45fc-85b7-860c8b43923d 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:14 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-28769598-724d-4985-b44e-b90587caf190 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created volume successfully. Sep 16 23:17:14 devstack quobyte-client[83246]: System call of process 101430 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:17:14 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=170, name=volume-0f01ee03-f885-45fc-85b7-860c8b43923d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:17:14 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:14 devstack cinder-volume[83223]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83223) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1383}} Sep 16 23:17:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf029fe0-c68a-40a7-90ca-698f41a192ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2942131-c9c6-4966-93c3-a8d1f65d751d', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af811ce-cb4a-4b62-abd5-e43f7dceb306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:14 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume volume-e2942131-c9c6-4966-93c3-a8d1f65d751d (e2942131-c9c6-4966-93c3-a8d1f65d751d): created successfully Sep 16 23:17:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af811ce-cb4a-4b62-abd5-e43f7dceb306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (aa0cec3a-9e75-4aa5-b410-6a6c455ca047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f01ee03-f885-45fc-85b7-860c8b43923d 1073741824" returned: 0 in 0.619s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:14 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f01ee03-f885-45fc-85b7-860c8b43923d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Flow 'volume_create_manager' (9255180a-408e-415e-b1a4-f9e94d01242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:14 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfa005e-23e6-4dd5-b42f-ba2ed2382ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:14 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-d08f38d2-ec65-4182-a6f9-83390ce1cc40 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created volume successfully. Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfa005e-23e6-4dd5-b42f-ba2ed2382ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7494af3d-b25c-46a6-b930-d36453dd2474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ffd2bb1e7b4bb2975cdcba39ffc252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7399814c-2d55-4d73-b47e-0176c338d8b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:14Z,use_quota=True,user_id='a207c4f9f92943539c428f0d3023398f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920ebdcd-f780-45eb-8fc9-dbe2c579059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920ebdcd-f780-45eb-8fc9-dbe2c579059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227d5b3e-c534-467f-af24-7c88f844b944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227d5b3e-c534-467f-af24-7c88f844b944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7494af3d-b25c-46a6-b930-d36453dd2474', 'volume_name': 'volume-7494af3d-b25c-46a6-b930-d36453dd2474', 'volume_size': 1, 'snapshot_id': '7399814c-2d55-4d73-b47e-0176c338d8b4'}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093c39aa-bc70-4282-ac41-28a5eb5f495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093c39aa-bc70-4282-ac41-28a5eb5f495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f881c83-67f2-41b3-a9a9-50743b275dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:15 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Volume 7494af3d-b25c-46a6-b930-d36453dd2474: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7494af3d-b25c-46a6-b930-d36453dd2474', 'volume_size': 1, 'snapshot_id': '7399814c-2d55-4d73-b47e-0176c338d8b4'} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f01ee03-f885-45fc-85b7-860c8b43923d" returned: 0 in 0.536s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] <== create_volume: return (1178ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.071s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1004883263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f27a7fc-a391-47b8-bbc2-cce8d0593fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:11Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Creating volume 2f27a7fc-a391-47b8-bbc2-cce8d0593fe5 {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:17:15 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:15 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=171, name=volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f9c70f-4731-46ba-a96b-e5504f9bc9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f01ee03-f885-45fc-85b7-860c8b43923d', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a501cc7-e84c-4dbf-a6d6-605582c3a80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5 1073741824" returned: 0 in 0.410s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:15 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume volume-0f01ee03-f885-45fc-85b7-860c8b43923d (0f01ee03-f885-45fc-85b7-860c8b43923d): created successfully Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a501cc7-e84c-4dbf-a6d6-605582c3a80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (71fc8ba6-1d5f-4786-9682-f77369d6fb55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5" returned: 0 in 0.352s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] <== create_volume: return (785ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.563s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T21:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-602198219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25735e3e-0d6c-483b-8a2e-f12d7186976e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a94ff71f64e50b4aa3d42cc1754a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T21:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T21:17:12Z,use_quota=True,user_id='fd1638d429d64b88bc8a49feb1a1120e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(666d422e-4bae-4ea2-82a8-c1772440a9c8),volume_type_id=666d422e-4bae-4ea2-82a8-c1772440a9c8)}" {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Creating volume 25735e3e-0d6c-483b-8a2e-f12d7186976e {{(pid=83223) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:17:15 devstack cinder-volume[83223]: INFO cinder.volume.drivers.remotefs [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] casted to 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d Sep 16 23:17:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-25735e3e-0d6c-483b-8a2e-f12d7186976e 1073741824 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-ee8ff545-da4f-4134-bb06-0a4086c4954b tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created volume successfully. Sep 16 23:17:16 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=172, name=volume-25735e3e-0d6c-483b-8a2e-f12d7186976e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41dcdf3-af17-4ed7-82d8-7cdf18c535b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197a9e61-82ca-40e2-88f9-e9b05052119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-25735e3e-0d6c-483b-8a2e-f12d7186976e 1073741824" returned: 0 in 0.367s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-25735e3e-0d6c-483b-8a2e-f12d7186976e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:16 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5 (2f27a7fc-a391-47b8-bbc2-cce8d0593fe5): created successfully Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197a9e61-82ca-40e2-88f9-e9b05052119e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (4683a442-89ac-4b9f-9b9a-d32fea4c78db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-25735e3e-0d6c-483b-8a2e-f12d7186976e" returned: 0 in 0.457s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] <== create_volume: return (852ms) {'provider_location': '10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'} {{(pid=83223) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.481s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "cinder-quobyte-7399814c-2d55-4d73-b47e-0176c338d8b4-7494af3d-b25c-46a6-b930-d36453dd2474" by "_create_volume_from_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:16 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-6533041d-2716-44de-8ff7-9ceee5d0e3a8 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created volume successfully. Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe5c8e9-ad52-453c-b26b-e56d76c4333c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25735e3e-0d6c-483b-8a2e-f12d7186976e', 'volume_size': 1}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:16 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1710fab0-82e1-453e-8644-4f26e9abe9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-7399814c-2d55-4d73-b47e-0176c338d8b4-7494af3d-b25c-46a6-b930-d36453dd2474" acquired by "_create_volume_from_snapshot" :: waited 0.212s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Creating volume 7494af3d-b25c-46a6-b930-d36453dd2474 from snapshot 7399814c-2d55-4d73-b47e-0176c338d8b4 {{(pid=83223) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Selected 10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d as target Quobyte volume. {{(pid=83223) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "cinder-quobyte-7494af3d-b25c-46a6-b930-d36453dd2474" by "_copy_volume_from_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:17 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume volume-25735e3e-0d6c-483b-8a2e-f12d7186976e (25735e3e-0d6c-483b-8a2e-f12d7186976e): created successfully Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1710fab0-82e1-453e-8644-4f26e9abe9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Flow 'volume_create_manager' (cbdad0d2-4eb2-440e-a1d6-e32cc3c2d7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-7494af3d-b25c-46a6-b930-d36453dd2474" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] snapshot: 7399814c-2d55-4d73-b47e-0176c338d8b4, volume: 7494af3d-b25c-46a6-b930-d36453dd2474, {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:17 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-af6436fd-611e-4718-9617-3367c78cc4ed tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created volume successfully. Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91ef15c-506f-417a-b8f2-724967613fae]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4" returned: 0 in 0.524s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77611aba-dede-495c-841b-bc7ff08eca49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Creating direct copy from snapshot {{(pid=83223) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4adb02-9d56-41fc-b09b-fdbedf0dab33]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:17 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-25735e3e-0d6c-483b-8a2e-f12d7186976e-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49" returned: 0 in 0.579s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:18 devstack cinder-volume[83223]: DEBUG cinder.utils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474 not found in is_blk_device check {{(pid=83223) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 23:17:18 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:18 devstack quobyte-client[83246]: The server volume:2a1c750e-65ce-49b1-af1a-d5773877e950@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=2a1c750e-65ce-49b1-af1a-d5773877e950, inode=173, name=volume-7494af3d-b25c-46a6-b930-d36453dd2474, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.50), requestorAccessMask=0 Sep 16 23:17:18 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-25735e3e-0d6c-483b-8a2e-f12d7186976e-delete_volume" acquired by "delete_volume" :: waited 0.307s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:19 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-quobyte-25735e3e-0d6c-483b-8a2e-f12d7186976e" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:19 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-25735e3e-0d6c-483b-8a2e-f12d7186976e" acquired by "delete_volume" :: waited 0.047s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:19 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f7bee4-7aa2-4cf0-b401-6b0eb474411a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:19 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-25735e3e-0d6c-483b-8a2e-f12d7186976e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:20 devstack quobyte-client[83246]: System call of process 101493 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:17:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-25735e3e-0d6c-483b-8a2e-f12d7186976e" returned: 0 in 1.434s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:20 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-25735e3e-0d6c-483b-8a2e-f12d7186976e {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:21 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-25735e3e-0d6c-483b-8a2e-f12d7186976e" returned: 0 in 0.310s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:21 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-25735e3e-0d6c-483b-8a2e-f12d7186976e" released by "delete_volume" :: held 2.348s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:22 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created reservations ['91a7f473-af2f-4e63-85cf-448996636ffc', 'c04678cc-d352-4312-b55e-f5aca6929379', '5097d1c6-bc0b-420e-bd9f-9cdaaeb23da2', '90a08182-515c-43aa-8931-1915634bda42'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.057s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:22 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:22 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:22 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.250s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:23 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:17:23 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Deleted volume successfully. Sep 16 23:17:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474" returned: 0 in 5.432s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:23 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:23 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25002a6-f26c-4a0c-8e7e-7683720a195a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:23 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-5bddda5a-5ba2-4fd9-a315-b4fee25e47f5 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-25735e3e-0d6c-483b-8a2e-f12d7186976e-delete_volume" released by "delete_volume" :: held 5.562s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:24 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-quobyte-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:24 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5" acquired by "delete_volume" :: waited 0.033s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:24 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c07a483-7b67-4f1d-8e75-edce6ad5e330]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49" returned: 0 in 0.779s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:24 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474 {{(pid=83223) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 23:17:24 devstack cinder-volume[83223]: INFO cinder.image.image_utils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Converted 1024.00 MB image at 187.55 MB/s Sep 16 23:17:24 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] File path /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474 is being set with permissions: 660 {{(pid=83223) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 23:17:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:24 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474" returned: 0 in 0.147s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-7494af3d-b25c-46a6-b930-d36453dd2474" released by "_copy_volume_from_snapshot" :: held 7.916s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-7399814c-2d55-4d73-b47e-0176c338d8b4-7494af3d-b25c-46a6-b930-d36453dd2474" released by "_create_volume_from_snapshot" :: held 7.998s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.229s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5" returned: 0 in 0.752s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f881c83-67f2-41b3-a9a9-50743b275dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7494af3d-b25c-46a6-b930-d36453dd2474', 'volume_size': 1, 'snapshot_id': '7399814c-2d55-4d73-b47e-0176c338d8b4'}' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227f080f-6eaa-4852-aab4-28ea7edfc5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5" returned: 0 in 0.322s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:25 devstack cinder-volume[83223]: INFO cinder.volume.flows.manager.create_volume [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Volume volume-7494af3d-b25c-46a6-b930-d36453dd2474 (7494af3d-b25c-46a6-b930-d36453dd2474): created successfully Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227f080f-6eaa-4852-aab4-28ea7edfc5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83223) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Flow 'volume_create_manager' (9255180a-408e-415e-b1a4-f9e94d01242a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83223) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5" released by "delete_volume" :: held 1.196s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:25 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-0b808b79-b8d8-4276-90fd-04cc0397bdff tempest-SnapshotDependencyTests-554899884 None] Created volume successfully. Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created reservations ['8dbf3cb3-f489-4ac6-bc49-1a614684cacc', '8a65c417-0eee-4866-a3f2-2862624deecc', 'e2c0c4fa-6982-4900-8817-add364c81365', 'd4ea718d-a88c-4b6a-9a81-356cd0be3cf3'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:25 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.120s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:17:26 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Deleted volume successfully. Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-91062cb8-aad4-46ba-ac40-f5e3a88bd992 tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-2f27a7fc-a391-47b8-bbc2-cce8d0593fe5-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "cinder-7399814c-2d55-4d73-b47e-0176c338d8b4-delete_snapshot" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-7399814c-2d55-4d73-b47e-0176c338d8b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:26 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "cinder-quobyte-77611aba-dede-495c-841b-bc7ff08eca49" by "delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-77611aba-dede-495c-841b-bc7ff08eca49" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "cinder-quobyte-7399814c-2d55-4d73-b47e-0176c338d8b4" by "_delete_snapshot" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-7399814c-2d55-4d73-b47e-0176c338d8b4" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Deleting offline snapshot 7399814c-2d55-4d73-b47e-0176c338d8b4 of volume 77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] snapshot_file for this snap is: volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 {{(pid=83223) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[e409905f-fb31-424e-9a07-ba1624766009]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:26 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4" returned: 0 in 0.399s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77611aba-dede-495c-841b-bc7ff08eca49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83223) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abb53c3-8d67-4ce1-b79f-d6963b49ca14]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-e2942131-c9c6-4966-93c3-a8d1f65d751d-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-e2942131-c9c6-4966-93c3-a8d1f65d751d-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:27 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-quobyte-e2942131-c9c6-4966-93c3-a8d1f65d751d" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-e2942131-c9c6-4966-93c3-a8d1f65d751d" acquired by "delete_volume" :: waited 0.013s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[44156185-0ff1-4fd6-982b-c7d2746d877a]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e2942131-c9c6-4966-93c3-a8d1f65d751d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49" returned: 0 in 0.679s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:27 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4" returned: 0 in 0.205s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e2942131-c9c6-4966-93c3-a8d1f65d751d" returned: 0 in 0.541s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e2942131-c9c6-4966-93c3-a8d1f65d751d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49.7399814c-2d55-4d73-b47e-0176c338d8b4" returned: 0 in 0.204s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-7399814c-2d55-4d73-b47e-0176c338d8b4" released by "_delete_snapshot" :: held 1.896s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-e2942131-c9c6-4966-93c3-a8d1f65d751d" returned: 0 in 0.207s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-77611aba-dede-495c-841b-bc7ff08eca49" released by "delete_snapshot" :: held 1.984s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-e2942131-c9c6-4966-93c3-a8d1f65d751d" released by "delete_volume" :: held 1.018s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_service.periodic_task [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83223) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:28 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.319s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-8de257d0-f6da-4f76-b382-f915855dea11 None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created reservations ['b3276e12-7ef0-47ac-8ad3-fe2a699dad16', 'e6ced74f-f765-435c-b361-abf5612bf807', '1084a188-dc34-44b9-9cb2-7ec30865abff', '90625d8b-8644-4434-8e36-8e4d462ee085'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Created reservations ['9df402d1-051f-4cf4-acca-dcfda93174ef', '50ec1a16-8fc3-48e6-881c-ded72f1b699c', 'd249f115-c7bf-400e-923a-a7a1de1c5e47', 'f614256b-2a6b-4542-8451-bfb6ceed0812'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-0f01ee03-f885-45fc-85b7-860c8b43923d-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:29 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Delete snapshot completed successfully. Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-20a2debc-3296-4f1d-8ee5-764f18c85c57 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-7399814c-2d55-4d73-b47e-0176c338d8b4-delete_snapshot" released by "delete_snapshot" :: held 3.264s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.403s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-0f01ee03-f885-45fc-85b7-860c8b43923d-delete_volume" acquired by "delete_volume" :: waited 0.199s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "cinder-77611aba-dede-495c-841b-bc7ff08eca49-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:29 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Deleted volume successfully. Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-1dc96570-9183-448b-acb5-f5bd99118a4d tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-e2942131-c9c6-4966-93c3-a8d1f65d751d-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:29 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-77611aba-dede-495c-841b-bc7ff08eca49-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-quobyte-0f01ee03-f885-45fc-85b7-860c8b43923d" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-0f01ee03-f885-45fc-85b7-860c8b43923d" acquired by "delete_volume" :: waited 0.022s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:30 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "cinder-quobyte-77611aba-dede-495c-841b-bc7ff08eca49" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:30 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd5ae02-6d5e-473e-b065-3b58cf6c7227]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f01ee03-f885-45fc-85b7-860c8b43923d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:30 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-77611aba-dede-495c-841b-bc7ff08eca49" acquired by "delete_volume" :: waited 0.262s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:30 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[2823dcfc-d7a4-47c1-a5a8-9308034a37cb]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f01ee03-f885-45fc-85b7-860c8b43923d" returned: 0 in 0.755s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:30 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f01ee03-f885-45fc-85b7-860c8b43923d {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-0f01ee03-f885-45fc-85b7-860c8b43923d" returned: 0 in 0.152s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-0f01ee03-f885-45fc-85b7-860c8b43923d" released by "delete_volume" :: held 1.156s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49" returned: 0 in 0.926s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:31 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-77611aba-dede-495c-841b-bc7ff08eca49" returned: 0 in 0.387s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:31 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-77611aba-dede-495c-841b-bc7ff08eca49" released by "delete_volume" :: held 1.513s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:31 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created reservations ['f07f81c7-03e3-4dd3-b7c9-6df84201560f', 'f3f027fe-6a3a-4f05-9339-35a4a6f7ed81', '9fec40fc-5f80-4c5c-8713-550e1152835e', 'ee3bb0a6-e928-40a8-932a-c5e8f0d941dc'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:31 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Created reservations ['bc1c5cfd-47f7-43d1-86df-5e153cd49ff3', 'd48e7e11-5095-4817-9314-23aa4f79f953', '3ede0505-1416-44a9-85bb-6814811759d6', '7ae1e69d-62e8-4d90-870d-0b771df4370b'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.440s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:17:32 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Deleted volume successfully. Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.502s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:32 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:17:33 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Deleted volume successfully. Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-23235122-0bfa-4249-aaa9-f9f6d43c28fd tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-0f01ee03-f885-45fc-85b7-860c8b43923d-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-968e83fd-ed61-415f-9ef2-b29ee1846389 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-77611aba-dede-495c-841b-bc7ff08eca49-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:33 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-quobyte-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9" acquired by "delete_volume" :: waited 0.017s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fa62f5-8dc3-457c-9b2d-8bd4f0056b36]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "cinder-7494af3d-b25c-46a6-b930-d36453dd2474-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-7494af3d-b25c-46a6-b930-d36453dd2474-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:33 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "cinder-quobyte-7494af3d-b25c-46a6-b930-d36453dd2474" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9" returned: 0 in 0.631s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:33 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:34 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-7494af3d-b25c-46a6-b930-d36453dd2474" acquired by "delete_volume" :: waited 0.211s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9" returned: 0 in 0.246s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:34 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[152869fd-5920-4fd5-9143-e4ee42430b6e]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:34 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9" released by "delete_volume" :: held 1.062s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:34 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created reservations ['e30ff7f7-c4ed-4ad8-a04f-e0807f355cc3', '07613560-5cac-4e64-9893-72fccb1a846d', 'f48b7ed8-6596-4784-85fc-4fbe379503c7', 'ac60a4e0-790a-4dfe-8af0-68337c59acf5'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:34 devstack quobyte-client[83246]: System call of process 101541 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 23:17:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474" returned: 0 in 0.620s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:34 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-7494af3d-b25c-46a6-b930-d36453dd2474" returned: 0 in 0.316s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a-delete_volume" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-quobyte-7494af3d-b25c-46a6-b930-d36453dd2474" released by "delete_volume" :: held 1.374s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.416s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:17:35 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Deleted volume successfully. Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a-delete_volume" acquired by "delete_volume" :: waited 0.284s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-dcd76261-f38a-45b2-addf-ba2d7ed402eb tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-8eab625f-b1cb-4951-9ec7-69fd2bbb94a9-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:35 devstack cinder-volume[83223]: WARNING cinder.volume.volume_utils [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "cinder-quobyte-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a" by "delete_volume" {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a" acquired by "delete_volume" :: waited 0.051s {{(pid=83223) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ac798-4cf5-4a74-93ef-c2b7fd2289f0]: (4, 'qcow2') {{(pid=83896) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 23:17:35 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Created reservations ['a6622d1f-d66d-4790-86bb-f4cde1fe3a0d', 'cc1f0663-5bad-48d1-8ce7-76105f5019e4', '880a1307-9123-45d1-bb3f-66b2cf81b2ef', 'cc035e5d-8d19-4bfa-b538-6578d8d1b39a'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a" returned: 0 in 0.628s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.224s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "rm -f /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867/volume-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a" returned: 0 in 0.230s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:36 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Deleted volume successfully. Sep 16 23:17:36 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-quobyte-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a" released by "delete_volume" :: held 1.130s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-382af3b3-6e53-4278-92f4-d19c49dc5255 tempest-SnapshotDependencyTests-554899884 None] Lock "cinder-7494af3d-b25c-46a6-b930-d36453dd2474-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG cinder.quota [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Created reservations ['59b69eec-5558-4f5f-ab4c-ffdce9bf8367', 'd3695fab-2b15-43df-bc81-891f94d2eb19', '453827b2-23d2-4fbb-9871-a591a4b39590', 'e7cbbe9d-e8a1-4dee-b216-6501d410998e'] {{(pid=83223) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Available shares ['10.10.41.181/cinder-vol-9a13734e-2746-4cca-aa82-a28e5158934d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e0a0a08ac121cc9e134c23bb7570867" returned: 0 in 0.101s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 23:17:37 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Deleted volume successfully. Sep 16 23:17:37 devstack cinder-volume[83223]: DEBUG cinder.coordination [None req-4989d452-2682-493c-8184-950f90722bae tempest-CreateVolumesFromSourceVolumeTest-340979409 None] Lock "cinder-9a6dd82c-b3f4-4826-8a9e-e1cb068b2e2a-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=83223) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 23:17:47 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=78,cinder:INSERT=28,cinder:UPDATE=91,cinder:DELETE=12 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 23:17:47 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writing DB stats cinder:SELECT=82,cinder:INSERT=28,cinder:UPDATE=157,cinder:DELETE=9 {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}